-- Logs begin at Thu 2022-04-21 09:48:28 UTC, end at Thu 2022-04-21 12:10:11 UTC. -- Apr 21 10:28:22.635614 n-d-811414-3 systemd[1]: Started Devstack devstack@n-super-cond.service. Apr 21 10:28:25.799002 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_db.sqlalchemy.engines [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93484) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Apr 21 10:28:26.025327 n-d-811414-3 nova-conductor[93484]: DEBUG nova.context [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),6c99d8ec-fb48-48af-b02b-a629a7c2cb6b(cell1) {{(pid=93484) load_cells /opt/stack/nova/nova/context.py:464}} Apr 21 10:28:26.028979 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_concurrency.lockutils [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:28:26.030424 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_concurrency.lockutils [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:28:26.031552 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_concurrency.lockutils [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:28:26.032963 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_concurrency.lockutils [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:28:26.063734 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_db.sqlalchemy.engines [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93484) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Apr 21 10:28:26.066051 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_db.sqlalchemy.engines [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93484) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Apr 21 10:28:26.077981 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_concurrency.lockutils [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] Acquired lock "singleton_lock" {{(pid=93484) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:266}} Apr 21 10:28:26.078749 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_concurrency.lockutils [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] Releasing lock "singleton_lock" {{(pid=93484) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:282}} Apr 21 10:28:26.079390 n-d-811414-3 nova-conductor[93484]: INFO oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] Starting 2 workers Apr 21 10:28:26.083888 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] Started child 94357 {{(pid=93484) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:576}} Apr 21 10:28:26.088133 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] Started child 94358 {{(pid=93484) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:576}} Apr 21 10:28:26.089410 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] Full set of CONF: {{(pid=93484) wait /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:650}} Apr 21 10:28:26.089801 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] ******************************************************************************** {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Apr 21 10:28:26.090128 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] Configuration options gathered from: {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Apr 21 10:28:26.090544 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] command line args: ['--config-file', '/etc/nova/nova.conf'] {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Apr 21 10:28:26.091225 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] config files: ['/etc/nova/nova.conf'] {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Apr 21 10:28:26.091478 n-d-811414-3 nova-conductor[94357]: INFO nova.service [-] Starting conductor node (version 23.2.1) Apr 21 10:28:26.091949 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] ================================================================================ {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Apr 21 10:28:26.092283 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] allow_resize_to_same_host = True {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:28:26.092771 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] arq_binding_timeout = 300 {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:28:26.093220 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] block_device_allocate_retries = 60 {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:28:26.093920 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] block_device_allocate_retries_interval = 3 {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:28:26.094544 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] cert = self.pem {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:28:26.094884 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] compute_driver = None {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:28:26.095366 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] compute_monitors = [] {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:28:26.095827 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] config_dir = [] {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:28:26.096283 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] config_drive_format = iso9660 {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:28:26.096655 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] config_file = ['/etc/nova/nova.conf'] {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:28:26.097110 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] config_source = [] {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:28:26.097515 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] console_host = n-d-811414-3 {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:28:26.097956 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] control_exchange = nova {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:28:26.098402 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] cpu_allocation_ratio = None {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:28:26.098798 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] daemon = False {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:28:26.099230 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] debug = True {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:28:26.106343 n-d-811414-3 nova-conductor[94358]: INFO nova.service [-] Starting conductor node (version 23.2.1) Apr 21 10:28:26.110480 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] default_access_ip_network_name = None {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:28:26.110641 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] default_availability_zone = nova {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:28:26.111046 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] default_ephemeral_format = None {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:28:26.111812 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:28:26.112513 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] default_schedule_zone = None {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:28:26.113147 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] disk_allocation_ratio = None {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:28:26.113774 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] enable_new_services = True {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:28:26.114454 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] enabled_apis = ['osapi_compute'] {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:28:26.115079 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] enabled_ssl_apis = [] {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:28:26.115949 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] flat_injected = False {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:28:26.116619 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] force_config_drive = True {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:28:26.117246 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] force_raw_images = True {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:28:26.120463 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] graceful_shutdown_timeout = 5 {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:28:26.121106 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] heal_instance_info_cache_interval = 60 {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:28:26.121710 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] host = n-d-811414-3 {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:28:26.122504 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] initial_cpu_allocation_ratio = 16.0 {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:28:26.123112 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] initial_disk_allocation_ratio = 1.0 {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:28:26.131066 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] initial_ram_allocation_ratio = 1.5 {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:28:26.131988 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:28:26.132655 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] instance_build_timeout = 0 {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:28:26.133286 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] instance_delete_interval = 300 {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:28:26.133917 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] instance_format = [instance: %(uuid)s] {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:28:26.134544 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] instance_name_template = instance-%08x {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:28:26.135184 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] instance_usage_audit = False {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:28:26.135821 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] instance_usage_audit_period = month {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:28:26.136460 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:28:26.136740 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_db.sqlalchemy.engines [None req-b9bd6054-ad53-47ba-b8f8-01c9103ad7c0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=94357) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Apr 21 10:28:26.137300 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] instances_path = /opt/stack/data/nova/instances {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:28:26.137755 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] internal_service_availability_zone = internal {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:28:26.138245 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] key = None {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:28:26.138746 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] live_migration_retry_count = 30 {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:28:26.139270 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] log_config_append = None {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:28:26.140939 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:28:26.141966 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] log_dir = None {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:28:26.143316 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] log_file = None {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:28:26.148348 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] log_options = True {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:28:26.148863 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] log_rotate_interval = 1 {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:28:26.149355 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] log_rotate_interval_type = days {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:28:26.149788 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] log_rotation_type = none {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:28:26.150186 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:28:26.150528 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:28:26.156547 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:28:26.160178 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:28:26.160708 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:28:26.161466 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] long_rpc_timeout = 1800 {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:28:26.162010 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] max_concurrent_builds = 10 {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:28:26.162591 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] max_concurrent_live_migrations = 1 {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:28:26.163132 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] max_concurrent_snapshots = 5 {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:28:26.164457 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] max_local_block_devices = 3 {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:28:26.165980 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] max_logfile_count = 30 {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:28:26.166543 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] max_logfile_size_mb = 200 {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:28:26.167750 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] maximum_instance_delete_attempts = 5 {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:28:26.170598 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] metadata_listen = 0.0.0.0 {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:28:26.172929 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_db.sqlalchemy.engines [None req-32b7f210-1a0b-4f4d-af1f-b53403811a2c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=94358) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Apr 21 10:28:26.173065 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] metadata_listen_port = 8775 {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:28:26.173666 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] metadata_workers = 2 {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:28:26.174241 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] migrate_max_retries = -1 {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:28:26.174869 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] mkisofs_cmd = genisoimage {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:28:26.175448 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] my_block_storage_ip = 10.222.0.13 {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:28:26.176000 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] my_ip = 10.222.0.13 {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:28:26.178959 n-d-811414-3 nova-conductor[94357]: DEBUG nova.service [None req-b9bd6054-ad53-47ba-b8f8-01c9103ad7c0 None None] Creating RPC server for service conductor {{(pid=94357) start /opt/stack/nova/nova/service.py:182}} Apr 21 10:28:26.183320 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] network_allocate_retries = 0 {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:28:26.184696 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:28:26.185362 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] osapi_compute_listen = 0.0.0.0 {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:28:26.186493 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] osapi_compute_listen_port = 8774 {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:28:26.189166 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] osapi_compute_unique_server_name_scope = {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:28:26.189680 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] osapi_compute_workers = 2 {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:28:26.190015 n-d-811414-3 nova-conductor[94358]: DEBUG nova.service [None req-32b7f210-1a0b-4f4d-af1f-b53403811a2c None None] Creating RPC server for service conductor {{(pid=94358) start /opt/stack/nova/nova/service.py:182}} Apr 21 10:28:26.191015 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] password_length = 12 {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:28:26.192305 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] periodic_enable = True {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:28:26.194148 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] periodic_fuzzy_delay = 60 {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:28:26.194661 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] pointer_model = usbtablet {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:28:26.195172 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] preallocate_images = none {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:28:26.196709 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] publish_errors = False {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:28:26.200296 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] pybasedir = /opt/stack/nova {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:28:26.200908 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] ram_allocation_ratio = None {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:28:26.201338 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] rate_limit_burst = 0 {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:28:26.201999 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] rate_limit_except_level = CRITICAL {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:28:26.202394 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] rate_limit_interval = 0 {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:28:26.202829 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] reboot_timeout = 0 {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:28:26.204124 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] reclaim_instance_interval = 0 {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:28:26.205660 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] record = None {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:28:26.206056 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] report_interval = 10 {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:28:26.206449 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] rescue_timeout = 0 {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:28:26.208713 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] reserved_host_cpus = 0 {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:28:26.209139 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] reserved_host_disk_mb = 0 {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:28:26.209530 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] reserved_host_memory_mb = 512 {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:28:26.209962 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] reserved_huge_pages = None {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:28:26.210360 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] resize_confirm_window = 0 {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:28:26.210757 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] resize_fs_using_block_device = False {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:28:26.212857 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] resume_guests_state_on_host_boot = False {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:28:26.214684 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:28:26.215881 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] rpc_response_timeout = 60 {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:28:26.218951 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] run_external_periodic_tasks = True {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:28:26.221073 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] running_deleted_instance_action = reap {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:28:26.221489 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] running_deleted_instance_poll_interval = 1800 {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:28:26.222163 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] running_deleted_instance_timeout = 0 {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:28:26.222562 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] scheduler_instance_sync_interval = 120 {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:28:26.222951 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] service_down_time = 60 {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:28:26.223493 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] servicegroup_driver = db {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:28:26.223904 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] shelved_offload_time = 0 {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:28:26.225509 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] shelved_poll_interval = 3600 {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:28:26.230834 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] shutdown_timeout = 0 {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:28:26.236645 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] source_is_ipv6 = False {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:28:26.239066 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] ssl_only = False {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:28:26.239486 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] state_path = /opt/stack/data/nova {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:28:26.239911 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] sync_power_state_interval = 600 {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:28:26.242413 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] sync_power_state_pool_size = 1000 {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:28:26.242834 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] syslog_log_facility = LOG_USER {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:28:26.244205 n-d-811414-3 nova-conductor[94358]: DEBUG nova.service [None req-32b7f210-1a0b-4f4d-af1f-b53403811a2c None None] Join ServiceGroup membership for this service conductor {{(pid=94358) start /opt/stack/nova/nova/service.py:199}} Apr 21 10:28:26.244329 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] tempdir = None {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:28:26.244811 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] timeout_nbd = 10 {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:28:26.245241 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] transport_url = **** {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:28:26.245588 n-d-811414-3 nova-conductor[94358]: DEBUG nova.servicegroup.drivers.db [None req-32b7f210-1a0b-4f4d-af1f-b53403811a2c None None] DB_Driver: join new ServiceGroup member n-d-811414-3 to the conductor group, service = {{(pid=94358) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}} Apr 21 10:28:26.245690 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] update_resources_interval = 0 {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:28:26.245990 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] use_cow_images = True {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:28:26.247708 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] use_eventlog = False {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:28:26.248103 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] use_journal = False {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:28:26.248530 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] use_json = False {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:28:26.252400 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] use_rootwrap_daemon = False {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:28:26.253813 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] use_stderr = False {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:28:26.255070 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] use_syslog = False {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:28:26.255475 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] vcpu_pin_set = None {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:28:26.255592 n-d-811414-3 nova-conductor[94357]: DEBUG nova.service [None req-b9bd6054-ad53-47ba-b8f8-01c9103ad7c0 None None] Join ServiceGroup membership for this service conductor {{(pid=94357) start /opt/stack/nova/nova/service.py:199}} Apr 21 10:28:26.255891 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] vif_plugging_is_fatal = True {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:28:26.256513 n-d-811414-3 nova-conductor[94357]: DEBUG nova.servicegroup.drivers.db [None req-b9bd6054-ad53-47ba-b8f8-01c9103ad7c0 None None] DB_Driver: join new ServiceGroup member n-d-811414-3 to the conductor group, service = {{(pid=94357) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}} Apr 21 10:28:26.256633 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] vif_plugging_timeout = 300 {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:28:26.257180 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] virt_mkfs = [] {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:28:26.257575 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] volume_usage_poll_interval = 0 {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:28:26.259127 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] watch_log_file = False {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:28:26.259585 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] web = /usr/share/spice-html5 {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 21 10:28:26.260238 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] oslo_concurrency.disable_process_locking = False {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.260714 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.261253 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] api.auth_strategy = keystone {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.261669 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] api.compute_link_prefix = None {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.262080 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.262508 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] api.dhcp_domain = novalocal {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.262904 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] api.enable_instance_password = True {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.263287 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] api.glance_link_prefix = None {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.263670 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.264100 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] api.instance_list_cells_batch_strategy = distributed {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.264606 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] api.instance_list_per_project_cells = False {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.265100 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] api.list_records_by_skipping_down_cells = True {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.265490 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] api.local_metadata_per_cell = False {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.265894 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] api.max_limit = 1000 {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.266287 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] api.metadata_cache_expiration = 15 {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.266915 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] api.neutron_default_tenant_id = default {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.267324 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] api.use_forwarded_for = False {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.267718 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] api.use_neutron_default_nets = False {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.268100 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.268512 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] api.vendordata_dynamic_failure_fatal = False {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.268899 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.269404 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] api.vendordata_dynamic_ssl_certfile = {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.269825 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] api.vendordata_dynamic_targets = [] {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.270332 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] api.vendordata_jsonfile_path = None {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.270848 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] api.vendordata_providers = ['StaticJSON'] {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.271340 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] cache.backend = dogpile.cache.memcached {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.271750 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] cache.backend_argument = **** {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.272195 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] cache.config_prefix = cache.oslo {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.272625 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] cache.dead_timeout = 60.0 {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.273128 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] cache.debug_cache_backend = False {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.273523 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] cache.enable_retry_client = False {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.273915 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] cache.enable_socket_keepalive = False {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.274366 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] cache.enabled = True {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.274854 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] cache.expiration_time = 600 {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.275467 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] cache.hashclient_retry_attempts = 2 {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.275813 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] cache.hashclient_retry_delay = 1.0 {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.276262 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] cache.memcache_dead_retry = 300 {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.276895 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.277327 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.277710 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] cache.memcache_pool_maxsize = 10 {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.278184 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] cache.memcache_pool_unused_timeout = 60 {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.278597 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] cache.memcache_servers = ['localhost:11211'] {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.278977 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] cache.memcache_socket_timeout = 1.0 {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.279509 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] cache.proxies = [] {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.279911 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] cache.retry_attempts = 2 {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.280498 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] cache.retry_delay = 0.0 {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.281391 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] cache.socket_keepalive_count = 1 {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.281773 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] cache.socket_keepalive_idle = 1 {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.282153 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] cache.socket_keepalive_interval = 1 {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.282587 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] cache.tls_allowed_ciphers = None {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.282987 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] cache.tls_cafile = None {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.283361 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] cache.tls_certfile = None {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.283736 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] cache.tls_enabled = False {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.284116 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] cache.tls_keyfile = None {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.284727 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] cinder.auth_section = None {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.285138 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] cinder.auth_type = password {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.285617 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] cinder.cafile = None {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.286107 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] cinder.catalog_info = volumev3::publicURL {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.286572 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] cinder.certfile = None {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.287158 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] cinder.collect_timing = False {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.287552 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] cinder.cross_az_attach = True {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.287947 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] cinder.endpoint_template = None {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.288350 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] cinder.http_retries = 3 {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.288789 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] cinder.insecure = False {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.289222 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] cinder.keyfile = None {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.289715 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] cinder.os_region_name = RegionOne {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.290141 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] cinder.split_loggers = False {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.290662 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] cinder.timeout = None {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.291079 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.291512 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] compute.cpu_dedicated_set = None {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.291889 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] compute.cpu_shared_set = None {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.292313 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] compute.image_type_exclude_list = [] {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.292762 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] compute.live_migration_wait_for_vif_plug = True {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.293146 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] compute.max_concurrent_disk_ops = 0 {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.293528 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] compute.max_disk_devices_to_attach = -1 {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.293918 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.294304 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] compute.resource_provider_association_refresh = 300 {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.294866 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] compute.shutdown_retry_interval = 10 {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.295303 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] conductor.workers = 2 {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.295799 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] console.allowed_origins = [] {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.296179 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] console.ssl_ciphers = None {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.297465 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] console.ssl_minimum_version = default {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.297932 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] consoleauth.token_ttl = 600 {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.298353 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] cyborg.cafile = None {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.298791 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] cyborg.certfile = None {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.299175 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] cyborg.collect_timing = False {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.299681 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] cyborg.connect_retries = None {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.300068 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] cyborg.connect_retry_delay = None {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.300463 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] cyborg.endpoint_override = None {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.301037 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] cyborg.insecure = False {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.301503 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] cyborg.keyfile = None {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.301877 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] cyborg.max_version = None {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.302249 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] cyborg.min_version = None {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.302645 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] cyborg.region_name = None {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.303002 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] cyborg.service_name = None {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.303472 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] cyborg.service_type = accelerator {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.303824 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] cyborg.split_loggers = False {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.304169 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] cyborg.status_code_retries = None {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.304563 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] cyborg.status_code_retry_delay = None {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.305345 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] cyborg.timeout = None {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.305599 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.305978 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] cyborg.version = None {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.306398 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] api_database.connection = **** {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.306855 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] api_database.connection_debug = 0 {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.307473 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] api_database.connection_parameters = {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.308210 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] api_database.connection_recycle_time = 3600 {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.308306 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] api_database.connection_trace = False {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.308639 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] api_database.max_overflow = None {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.309068 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] api_database.max_pool_size = None {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.309775 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] api_database.max_retries = 10 {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.309957 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] api_database.mysql_sql_mode = TRADITIONAL {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.310308 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] api_database.pool_timeout = None {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.310708 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] api_database.retry_interval = 10 {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.311083 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] api_database.slave_connection = **** {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.311463 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] api_database.sqlite_synchronous = True {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.311848 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] devices.enabled_vgpu_types = [] {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.312364 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.312758 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] ephemeral_storage_encryption.enabled = False {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.313193 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] ephemeral_storage_encryption.key_size = 512 {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.313664 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] glance.api_servers = None {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.314053 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] glance.cafile = None {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.314436 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] glance.certfile = None {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.314868 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] glance.collect_timing = False {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.315237 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] glance.connect_retries = None {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.315646 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] glance.connect_retry_delay = None {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.316039 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] glance.debug = False {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.316447 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] glance.default_trusted_certificate_ids = [] {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.316827 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] glance.enable_certificate_validation = False {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.317278 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] glance.enable_rbd_download = False {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.317935 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] glance.endpoint_override = None {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.318343 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] glance.insecure = False {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.318726 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] glance.keyfile = None {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.319095 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] glance.max_version = None {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.319639 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] glance.min_version = None {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.320153 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] glance.num_retries = 3 {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.320584 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] glance.rbd_ceph_conf = {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.320965 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] glance.rbd_connect_timeout = 5 {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.321358 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] glance.rbd_pool = {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.321795 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] glance.rbd_user = {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.322170 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] glance.region_name = None {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.322539 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] glance.service_name = None {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.322931 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] glance.service_type = image {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.323320 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] glance.split_loggers = False {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.323679 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] glance.status_code_retries = None {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.324048 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] glance.status_code_retry_delay = None {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.324432 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] glance.timeout = None {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.324844 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] glance.valid_interfaces = ['internal', 'public'] {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.325284 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] glance.verify_glance_signatures = False {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.325660 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] glance.version = None {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.326063 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] guestfs.debug = False {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.326473 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] hyperv.config_drive_cdrom = False {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.326853 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] hyperv.config_drive_inject_password = False {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.327234 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] hyperv.dynamic_memory_ratio = 1.0 {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.327827 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] hyperv.enable_instance_metrics_collection = False {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.328209 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] hyperv.enable_remotefx = False {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.328626 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] hyperv.instances_path_share = {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.329206 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] hyperv.iscsi_initiator_list = [] {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.329618 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] hyperv.limit_cpu_features = False {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.330025 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.330404 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.330786 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] hyperv.power_state_check_timeframe = 60 {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.331161 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] hyperv.power_state_event_polling_interval = 2 {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.331562 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.331939 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] hyperv.use_multipath_io = False {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.332319 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] hyperv.volume_attach_retry_count = 10 {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.332722 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] hyperv.volume_attach_retry_interval = 5 {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.333133 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] hyperv.vswitch_name = None {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.333520 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.333931 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] mks.enabled = False {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.335006 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.335433 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] image_cache.manager_interval = 2400 {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.335814 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] image_cache.precache_concurrency = 1 {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.336210 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] image_cache.remove_unused_base_images = True {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.336621 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.337014 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.337419 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] image_cache.subdirectory_name = _base {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.337870 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] ironic.api_max_retries = 60 {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.338271 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] ironic.api_retry_interval = 2 {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.338663 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] ironic.auth_section = None {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.339040 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] ironic.auth_type = None {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.339409 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] ironic.cafile = None {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.339783 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] ironic.certfile = None {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.340159 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] ironic.collect_timing = False {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.340585 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] ironic.connect_retries = None {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.340993 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] ironic.connect_retry_delay = None {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.341369 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] ironic.endpoint_override = None {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.341745 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] ironic.insecure = False {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.342109 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] ironic.keyfile = None {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.342476 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] ironic.max_version = None {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.342840 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] ironic.min_version = None {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.343211 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] ironic.partition_key = None {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.344169 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] ironic.peer_list = [] {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.344639 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] ironic.region_name = None {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.345019 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] ironic.serial_console_state_timeout = 10 {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.345396 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] ironic.service_name = None {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.345785 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] ironic.service_type = baremetal {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.346163 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] ironic.split_loggers = False {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.346533 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] ironic.status_code_retries = None {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.346897 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] ironic.status_code_retry_delay = None {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.347270 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] ironic.timeout = None {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.347672 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] ironic.valid_interfaces = ['internal', 'public'] {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.348042 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] ironic.version = None {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.348524 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.348941 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] key_manager.fixed_key = **** {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.349404 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.349777 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] barbican.barbican_api_version = None {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.350183 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] barbican.barbican_endpoint = None {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.350595 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] barbican.barbican_endpoint_type = public {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.350985 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] barbican.cafile = None {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.351355 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] barbican.certfile = None {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.351730 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] barbican.collect_timing = False {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.352287 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] barbican.insecure = False {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.352678 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] barbican.keyfile = None {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.353076 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] barbican.number_of_retries = 60 {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.353453 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] barbican.retry_delay = 1 {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.353825 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] barbican.split_loggers = False {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.354200 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] barbican.timeout = None {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.354572 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] barbican.verify_ssl = True {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.354944 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] barbican.verify_ssl_path = None {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.355322 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] vault.approle_role_id = None {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.355690 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] vault.approle_secret_id = None {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.356053 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] vault.cafile = None {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.356452 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] vault.certfile = None {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.356855 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] vault.collect_timing = False {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.357332 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] vault.insecure = False {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.357702 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] vault.keyfile = None {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.358120 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] vault.kv_mountpoint = secret {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.358498 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] vault.kv_version = 2 {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.358869 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] vault.root_token_id = None {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.359509 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] vault.split_loggers = False {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.359893 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] vault.ssl_ca_crt_file = None {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.360274 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] vault.timeout = None {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.360673 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] vault.use_ssl = False {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.361096 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.361529 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] keystone.cafile = None {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.361905 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] keystone.certfile = None {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.362303 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] keystone.collect_timing = False {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.362689 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] keystone.connect_retries = None {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.363101 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] keystone.connect_retry_delay = None {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.363449 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] keystone.endpoint_override = None {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.363823 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] keystone.insecure = False {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.364191 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] keystone.keyfile = None {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.364591 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] keystone.max_version = None {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.364974 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] keystone.min_version = None {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.365666 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] keystone.region_name = None {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.365991 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] keystone.service_name = None {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.366397 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] keystone.service_type = identity {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.366795 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] keystone.split_loggers = False {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.367146 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] keystone.status_code_retries = None {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.367525 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] keystone.status_code_retry_delay = None {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.367893 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] keystone.timeout = None {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.368298 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] keystone.valid_interfaces = ['internal', 'public'] {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.368693 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] keystone.version = None {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.369173 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] libvirt.connection_uri = {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.369564 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] libvirt.cpu_mode = None {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.369968 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] libvirt.cpu_model_extra_flags = [] {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.370411 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] libvirt.cpu_models = [] {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.370812 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] libvirt.device_detach_attempts = 8 {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.371186 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] libvirt.device_detach_timeout = 20 {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.371568 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] libvirt.disk_cachemodes = [] {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.371957 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] libvirt.disk_prefix = None {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.372341 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] libvirt.enabled_perf_events = [] {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.372743 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] libvirt.file_backed_memory = 0 {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.373118 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] libvirt.gid_maps = [] {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.373484 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] libvirt.hw_disk_discard = None {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.373858 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] libvirt.hw_machine_type = None {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.374244 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] libvirt.images_rbd_ceph_conf = {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.375357 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.375608 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.375993 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] libvirt.images_rbd_glance_store_name = {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.376397 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] libvirt.images_rbd_pool = rbd {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.376785 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] libvirt.images_type = default {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.377156 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] libvirt.images_volume_group = None {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.377533 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] libvirt.inject_key = False {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.377905 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] libvirt.inject_partition = -2 {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.378292 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] libvirt.inject_password = False {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.378734 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] libvirt.iscsi_iface = None {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.379054 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] libvirt.iser_use_multipath = False {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.379435 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] libvirt.live_migration_bandwidth = 0 {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.379814 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] libvirt.live_migration_completion_timeout = 800 {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.380196 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] libvirt.live_migration_downtime = 500 {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.380599 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] libvirt.live_migration_downtime_delay = 75 {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.380975 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] libvirt.live_migration_downtime_steps = 10 {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.381356 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] libvirt.live_migration_inbound_addr = None {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.381732 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] libvirt.live_migration_permit_auto_converge = False {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.382107 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] libvirt.live_migration_permit_post_copy = False {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.382485 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] libvirt.live_migration_scheme = None {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.382893 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] libvirt.live_migration_timeout_action = abort {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.383265 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] libvirt.live_migration_tunnelled = False {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.383635 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] libvirt.live_migration_uri = None {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.384019 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] libvirt.live_migration_with_native_tls = False {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.384402 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] libvirt.max_queues = None {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.384784 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] libvirt.mem_stats_period_seconds = 10 {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.385172 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] libvirt.nfs_mount_options = None {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.385688 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.386066 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] libvirt.num_aoe_discover_tries = 3 {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.386442 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] libvirt.num_iser_scan_tries = 5 {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.386811 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] libvirt.num_memory_encrypted_guests = None {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.387191 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] libvirt.num_nvme_discover_tries = 5 {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.387564 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] libvirt.num_pcie_ports = 0 {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.387952 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] libvirt.num_volume_scan_tries = 5 {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.388337 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] libvirt.pmem_namespaces = [] {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.388726 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] libvirt.quobyte_client_cfg = None {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.389206 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.389581 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] libvirt.rbd_connect_timeout = 5 {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.389959 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.390413 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.390786 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] libvirt.rbd_secret_uuid = None {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.391152 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] libvirt.rbd_user = None {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.391546 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] libvirt.realtime_scheduler_priority = 1 {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.391941 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] libvirt.remote_filesystem_transport = ssh {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.392335 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] libvirt.rescue_image_id = None {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.392735 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] libvirt.rescue_kernel_id = None {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.393109 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] libvirt.rescue_ramdisk_id = None {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.393501 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] libvirt.rng_dev_path = /dev/urandom {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.393871 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] libvirt.rx_queue_size = None {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.394267 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] libvirt.smbfs_mount_options = {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.394737 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.395120 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] libvirt.snapshot_compression = False {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.395489 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] libvirt.snapshot_image_format = None {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.395957 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.396338 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] libvirt.sparse_logical_volumes = False {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.396733 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] libvirt.swtpm_enabled = False {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.397147 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] libvirt.swtpm_group = tss {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.397551 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] libvirt.swtpm_user = tss {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.397939 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] libvirt.sysinfo_serial = unique {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.398319 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] libvirt.tx_queue_size = None {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.398700 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] libvirt.uid_maps = [] {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.399114 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] libvirt.use_virtio_for_bridges = True {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.399465 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] libvirt.virt_type = kvm {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.399854 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] libvirt.volume_clear = zero {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.400231 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] libvirt.volume_clear_size = 0 {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.400630 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] libvirt.volume_use_multipath = False {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.401002 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] libvirt.vzstorage_cache_path = None {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.401390 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.401800 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] libvirt.vzstorage_mount_group = qemu {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.402182 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] libvirt.vzstorage_mount_opts = [] {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.402580 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] libvirt.vzstorage_mount_perms = 0770 {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.403065 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.403456 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] libvirt.vzstorage_mount_user = stack {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.403833 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.404247 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] neutron.auth_section = None {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.404670 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] neutron.auth_type = password {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.405042 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] neutron.cafile = None {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.405413 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] neutron.certfile = None {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.406332 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] neutron.collect_timing = False {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.406780 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] neutron.connect_retries = None {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.407157 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] neutron.connect_retry_delay = None {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.407547 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] neutron.default_floating_pool = public {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.407920 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] neutron.endpoint_override = None {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.408298 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] neutron.extension_sync_interval = 600 {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.408704 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] neutron.http_retries = 3 {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.409082 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] neutron.insecure = False {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.409455 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] neutron.keyfile = None {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.409831 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] neutron.max_version = None {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.410229 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] neutron.metadata_proxy_shared_secret = **** {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.410590 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] neutron.min_version = None {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.410987 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] neutron.ovs_bridge = br-int {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.411365 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] neutron.physnets = [] {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.411752 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] neutron.region_name = RegionOne {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.412139 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] neutron.service_metadata_proxy = True {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.412537 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] neutron.service_name = None {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.412967 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] neutron.service_type = network {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.413307 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] neutron.split_loggers = False {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.413676 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] neutron.status_code_retries = None {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.414044 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] neutron.status_code_retry_delay = None {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.414414 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] neutron.timeout = None {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.414816 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] neutron.valid_interfaces = ['internal', 'public'] {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.415185 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] neutron.version = None {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.415572 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] notifications.bdms_in_notifications = False {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.415985 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] notifications.default_level = INFO {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.416454 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] notifications.notification_format = unversioned {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.416772 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] notifications.notify_on_state_change = None {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.417172 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.417565 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] pci.alias = [] {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.417946 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] pci.passthrough_whitelist = [] {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.418360 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] placement.auth_section = None {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.418757 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] placement.auth_type = password {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.419148 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] placement.auth_url = http://10.222.0.13/identity {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.419709 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] placement.cafile = None {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.420081 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] placement.certfile = None {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.420487 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] placement.collect_timing = False {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.420856 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] placement.connect_retries = None {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.421353 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] placement.connect_retry_delay = None {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.421832 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] placement.default_domain_id = None {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.422285 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] placement.default_domain_name = None {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.422667 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] placement.domain_id = None {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.423104 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] placement.domain_name = None {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.423412 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] placement.endpoint_override = None {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.423787 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] placement.insecure = False {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.424158 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] placement.keyfile = None {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.424584 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] placement.max_version = None {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.424920 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] placement.min_version = None {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.425313 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] placement.password = **** {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.425707 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] placement.project_domain_id = None {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.426120 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] placement.project_domain_name = Default {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.426567 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] placement.project_id = None {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.426904 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] placement.project_name = service {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.427329 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] placement.region_name = RegionOne {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.427676 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] placement.service_name = None {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.428063 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] placement.service_type = placement {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.428467 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] placement.split_loggers = False {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.428845 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] placement.status_code_retries = None {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.429216 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] placement.status_code_retry_delay = None {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.429589 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] placement.system_scope = None {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.429958 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] placement.timeout = None {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.430366 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] placement.trust_id = None {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.430716 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] placement.user_domain_id = None {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.431130 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] placement.user_domain_name = Default {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.431447 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] placement.user_id = None {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.431841 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] placement.username = placement {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.432245 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] placement.valid_interfaces = ['internal', 'public'] {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.432635 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] placement.version = None {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.433079 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] powervm.disk_driver = localdisk {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.433530 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] powervm.proc_units_factor = 0.1 {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.433866 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] powervm.volume_group_name = {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.434260 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] quota.cores = 20 {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.434634 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] quota.count_usage_from_placement = False {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.435027 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] quota.driver = nova.quota.DbQuotaDriver {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.435428 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] quota.injected_file_content_bytes = 10240 {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.435808 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] quota.injected_file_path_length = 255 {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.436185 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] quota.injected_files = 5 {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.436606 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] quota.instances = 10 {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.436976 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] quota.key_pairs = 100 {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.438073 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] quota.metadata_items = 128 {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.438456 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] quota.ram = 51200 {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.438845 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] quota.recheck_quota = True {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.439205 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] quota.server_group_members = 10 {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.439684 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] quota.server_groups = 10 {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.439970 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] rdp.enabled = False {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.440644 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.441069 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.441445 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.441830 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] scheduler.image_metadata_prefilter = False {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.442212 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.442616 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] scheduler.max_attempts = 3 {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.442997 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] scheduler.max_placement_results = 1000 {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.443413 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.443786 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] scheduler.query_placement_for_availability_zone = False {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.444159 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] scheduler.query_placement_for_image_type_support = False {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.444559 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.444955 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] scheduler.workers = 2 {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.445388 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.445780 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.446205 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.446605 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.446986 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.447367 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.447751 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.448311 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.448725 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] filter_scheduler.host_subset_size = 1 {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.449117 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] filter_scheduler.image_properties_default_architecture = None {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.449483 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.449876 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] filter_scheduler.isolated_hosts = [] {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.450254 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] filter_scheduler.isolated_images = [] {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.450635 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] filter_scheduler.max_instances_per_host = 50 {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.451040 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.451382 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.451785 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.452266 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.453251 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.453690 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.454211 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.454687 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] filter_scheduler.track_instance_changes = False {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.455124 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.455546 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] metrics.required = True {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.455964 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] metrics.weight_multiplier = 1.0 {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.456376 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] metrics.weight_of_unavailable = -10000.0 {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.456812 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] metrics.weight_setting = [] {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.457438 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.457851 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] serial_console.enabled = False {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.458302 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] serial_console.port_range = 10000:20000 {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.458724 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.459229 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.459570 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] serial_console.serialproxy_port = 6083 {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.459997 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] service_user.auth_section = None {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.460450 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] service_user.auth_type = password {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.460862 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] service_user.cafile = None {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.461270 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] service_user.certfile = None {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.461679 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] service_user.collect_timing = False {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.462088 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] service_user.insecure = False {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.462500 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] service_user.keyfile = None {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.462930 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] service_user.send_service_user_token = True {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.463350 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] service_user.split_loggers = False {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.463800 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] service_user.timeout = None {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.464229 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] spice.agent_enabled = True {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.464656 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] spice.enabled = False {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.465347 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.465872 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] spice.html5proxy_host = 0.0.0.0 {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.466334 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] spice.html5proxy_port = 6082 {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.466888 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] spice.server_listen = 127.0.0.1 {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.467393 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.467934 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] upgrade_levels.baseapi = None {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.468719 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] upgrade_levels.cert = None {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.469217 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] upgrade_levels.compute = auto {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.469599 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] upgrade_levels.conductor = None {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.469975 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] upgrade_levels.scheduler = None {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.470392 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] vendordata_dynamic_auth.auth_section = None {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.470775 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] vendordata_dynamic_auth.auth_type = None {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.471151 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] vendordata_dynamic_auth.cafile = None {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.471631 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] vendordata_dynamic_auth.certfile = None {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.471903 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] vendordata_dynamic_auth.collect_timing = False {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.472278 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] vendordata_dynamic_auth.insecure = False {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.472740 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] vendordata_dynamic_auth.keyfile = None {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.473067 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] vendordata_dynamic_auth.split_loggers = False {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.473444 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] vendordata_dynamic_auth.timeout = None {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.473988 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] vmware.api_retry_count = 10 {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.474271 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] vmware.ca_file = None {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.474633 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] vmware.cache_prefix = None {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.475001 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] vmware.cluster_name = None {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.475377 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] vmware.connection_pool_size = 10 {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.475746 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] vmware.console_delay_seconds = None {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.476123 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] vmware.datastore_regex = None {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.476536 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] vmware.host_ip = None {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.476912 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] vmware.host_password = **** {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.477294 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] vmware.host_port = 443 {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.477675 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] vmware.host_username = None {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.478054 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] vmware.insecure = False {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.478434 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] vmware.integration_bridge = None {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.478812 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] vmware.maximum_objects = 100 {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.479181 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] vmware.pbm_default_policy = None {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.479565 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] vmware.pbm_enabled = False {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.479944 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] vmware.pbm_wsdl_location = None {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.480422 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.480757 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] vmware.serial_port_proxy_uri = None {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.481137 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] vmware.serial_port_service_uri = None {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.481639 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] vmware.task_poll_interval = 0.5 {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.481915 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] vmware.use_linked_clone = True {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.482285 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] vmware.vnc_keymap = en-us {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.482666 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] vmware.vnc_port = 5900 {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.483043 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] vmware.vnc_port_total = 10000 {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.483491 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] vnc.auth_schemes = ['none'] {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.483945 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] vnc.enabled = True {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.484599 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.485000 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] vnc.novncproxy_host = 0.0.0.0 {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.485397 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] vnc.novncproxy_port = 6080 {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.485816 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] vnc.server_listen = 127.0.0.1 {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.486219 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.486596 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] vnc.vencrypt_ca_certs = None {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.486969 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] vnc.vencrypt_client_cert = None {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.487340 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] vnc.vencrypt_client_key = None {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.487796 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] workarounds.disable_fallback_pcpu_query = False {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.488175 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] workarounds.disable_group_policy_check_upcall = False {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.488634 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.489011 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] workarounds.disable_native_luksv1 = False {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.489388 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] workarounds.disable_rootwrap = False {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.489766 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] workarounds.enable_numa_live_migration = False {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.490399 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.490797 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.491134 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] workarounds.handle_virt_lifecycle_events = True {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.491508 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] workarounds.libvirt_disable_apic = False {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.491992 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] workarounds.never_download_image_if_on_rbd = False {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.492254 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] workarounds.rbd_volume_local_attach = False {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.492655 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.493040 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.493473 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.493867 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] wsgi.client_socket_timeout = 900 {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.494248 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] wsgi.default_pool_size = 1000 {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.494676 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] wsgi.keep_alive = True {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.495016 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] wsgi.max_header_line = 16384 {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.495395 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] wsgi.secure_proxy_ssl_header = None {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.495774 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] wsgi.ssl_ca_file = None {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.496155 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] wsgi.ssl_cert_file = None {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.496564 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] wsgi.ssl_key_file = None {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.496954 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] wsgi.tcp_keepidle = 600 {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.497357 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.497735 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] zvm.ca_file = None {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.498104 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] zvm.cloud_connector_url = None {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.498726 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.498989 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] zvm.reachable_timeout = 300 {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.499429 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] oslo_policy.enforce_new_defaults = False {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.500428 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] oslo_policy.enforce_scope = False {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.500854 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] oslo_policy.policy_default_rule = default {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.501296 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.501699 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] oslo_policy.policy_file = policy.yaml {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.502138 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.502513 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.502885 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.503255 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.503633 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.504045 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.504844 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] profiler.connection_string = messaging:// {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.505050 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] profiler.enabled = False {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.505457 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] profiler.es_doc_type = notification {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.505855 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] profiler.es_scroll_size = 10000 {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.506246 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] profiler.es_scroll_time = 2m {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.506621 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] profiler.filter_error_trace = False {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.507006 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] profiler.hmac_keys = SECRET_KEY {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.507394 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] profiler.sentinel_service_name = mymaster {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.507785 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] profiler.socket_timeout = 0.1 {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.508157 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] profiler.trace_sqlalchemy = False {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.510446 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] database.backend = sqlalchemy {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.510446 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] database.connection = **** {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.510446 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] database.connection_debug = 0 {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.510446 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] database.connection_parameters = {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.510446 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] database.connection_recycle_time = 3600 {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.511269 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] database.connection_trace = False {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.511421 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] database.db_inc_retry_interval = True {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.511787 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] database.db_max_retries = 20 {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.512227 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] database.db_max_retry_interval = 10 {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.512572 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] database.db_retry_interval = 1 {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.512961 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] database.max_overflow = 50 {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.513344 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] database.max_pool_size = 5 {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.513731 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] database.max_retries = 10 {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.514110 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] database.mysql_enable_ndb = False {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.514499 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] database.mysql_sql_mode = TRADITIONAL {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.514977 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] database.pool_timeout = None {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.515858 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] database.retry_interval = 10 {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.516224 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] database.slave_connection = **** {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.516770 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] database.sqlite_synchronous = True {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.517150 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] database.use_db_reconnect = False {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.517532 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] database.use_tpool = False {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.517947 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] remote_debug.host = None {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.518340 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] remote_debug.port = None {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.518756 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.519141 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.519527 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.519904 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.520290 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.520694 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.521080 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.521476 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.521873 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.522369 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.522647 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.523037 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.523440 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.523824 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.524213 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.524640 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.525133 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.525435 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.525822 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.526154 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.526548 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.526945 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] oslo_messaging_rabbit.ssl = False {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.527339 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.527732 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.528150 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.528574 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] oslo_messaging_rabbit.ssl_version = {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.529027 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.529407 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] oslo_messaging_notifications.retry = -1 {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.529822 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.530242 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] oslo_messaging_notifications.transport_url = **** {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.530669 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] oslo_reports.file_event_handler = None {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.531125 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] oslo_reports.file_event_handler_interval = 1 {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.531528 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] oslo_reports.log_dir = None {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 21 10:28:26.531876 n-d-811414-3 nova-conductor[93484]: DEBUG oslo_service.service [None req-e1528ec8-41ac-4cc9-88a4-3ce936acdc6e None None] ******************************************************************************** {{(pid=93484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Apr 21 10:31:26.223425 n-d-811414-3 nova-conductor[94358]: ERROR oslo.messaging._drivers.impl_rabbit [-] [764b4c1f-4a95-4767-989c-d3f562ce3759] AMQP server on 10.222.0.13:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 21 10:31:26.233688 n-d-811414-3 nova-conductor[94357]: ERROR oslo.messaging._drivers.impl_rabbit [-] [694bc511-65ea-420f-8d85-4aed262a2a29] AMQP server on 10.222.0.13:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 21 10:31:27.244239 n-d-811414-3 nova-conductor[94358]: INFO oslo.messaging._drivers.impl_rabbit [-] [764b4c1f-4a95-4767-989c-d3f562ce3759] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 34036. Apr 21 10:31:27.247123 n-d-811414-3 nova-conductor[94357]: INFO oslo.messaging._drivers.impl_rabbit [-] [694bc511-65ea-420f-8d85-4aed262a2a29] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 34038. Apr 21 10:34:27.233760 n-d-811414-3 nova-conductor[94358]: ERROR oslo.messaging._drivers.impl_rabbit [-] [764b4c1f-4a95-4767-989c-d3f562ce3759] AMQP server on 10.222.0.13:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 21 10:34:27.243680 n-d-811414-3 nova-conductor[94357]: ERROR oslo.messaging._drivers.impl_rabbit [-] [694bc511-65ea-420f-8d85-4aed262a2a29] AMQP server on 10.222.0.13:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 21 10:34:28.249433 n-d-811414-3 nova-conductor[94358]: INFO oslo.messaging._drivers.impl_rabbit [-] [764b4c1f-4a95-4767-989c-d3f562ce3759] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 34102. Apr 21 10:34:28.254343 n-d-811414-3 nova-conductor[94357]: INFO oslo.messaging._drivers.impl_rabbit [-] [694bc511-65ea-420f-8d85-4aed262a2a29] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 34104. Apr 21 10:37:28.243576 n-d-811414-3 nova-conductor[94358]: ERROR oslo.messaging._drivers.impl_rabbit [-] [764b4c1f-4a95-4767-989c-d3f562ce3759] AMQP server on 10.222.0.13:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 21 10:37:28.251354 n-d-811414-3 nova-conductor[94357]: ERROR oslo.messaging._drivers.impl_rabbit [-] [694bc511-65ea-420f-8d85-4aed262a2a29] AMQP server on 10.222.0.13:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 21 10:37:29.269773 n-d-811414-3 nova-conductor[94358]: INFO oslo.messaging._drivers.impl_rabbit [-] [764b4c1f-4a95-4767-989c-d3f562ce3759] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 34218. Apr 21 10:37:29.273534 n-d-811414-3 nova-conductor[94357]: INFO oslo.messaging._drivers.impl_rabbit [-] [694bc511-65ea-420f-8d85-4aed262a2a29] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 34220. Apr 21 10:38:18.376672 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_db.sqlalchemy.engines [None req-44761022-5a2d-4631-b64d-f28b223c038f tempest-DeleteServersAdminTestJSON-583588343 tempest-DeleteServersAdminTestJSON-583588343-project] Parent process 93484 forked (94358) with an open database connection, which is being discarded and recreated. {{(pid=94358) checkout /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:403}} Apr 21 10:38:20.330469 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-44761022-5a2d-4631-b64d-f28b223c038f tempest-DeleteServersAdminTestJSON-583588343 tempest-DeleteServersAdminTestJSON-583588343-project] Took 1.92 seconds to select destinations for 1 instance(s). {{(pid=94358) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 21 10:38:20.436565 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-44761022-5a2d-4631-b64d-f28b223c038f tempest-DeleteServersAdminTestJSON-583588343 tempest-DeleteServersAdminTestJSON-583588343-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:38:20.454628 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-44761022-5a2d-4631-b64d-f28b223c038f tempest-DeleteServersAdminTestJSON-583588343 tempest-DeleteServersAdminTestJSON-583588343-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:38:20.487447 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_db.sqlalchemy.engines [None req-44761022-5a2d-4631-b64d-f28b223c038f tempest-DeleteServersAdminTestJSON-583588343 tempest-DeleteServersAdminTestJSON-583588343-project] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=94358) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Apr 21 10:38:20.702180 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-44761022-5a2d-4631-b64d-f28b223c038f tempest-DeleteServersAdminTestJSON-583588343 tempest-DeleteServersAdminTestJSON-583588343-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:38:20.709524 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-44761022-5a2d-4631-b64d-f28b223c038f tempest-DeleteServersAdminTestJSON-583588343 tempest-DeleteServersAdminTestJSON-583588343-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:38:20.710847 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-44761022-5a2d-4631-b64d-f28b223c038f tempest-DeleteServersAdminTestJSON-583588343 tempest-DeleteServersAdminTestJSON-583588343-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:38:20.712268 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-44761022-5a2d-4631-b64d-f28b223c038f tempest-DeleteServersAdminTestJSON-583588343 tempest-DeleteServersAdminTestJSON-583588343-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:38:20.766165 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_db.sqlalchemy.engines [None req-44761022-5a2d-4631-b64d-f28b223c038f tempest-DeleteServersAdminTestJSON-583588343 tempest-DeleteServersAdminTestJSON-583588343-project] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=94358) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Apr 21 10:38:20.828275 n-d-811414-3 nova-conductor[94358]: DEBUG nova.quota [None req-44761022-5a2d-4631-b64d-f28b223c038f tempest-DeleteServersAdminTestJSON-583588343 tempest-DeleteServersAdminTestJSON-583588343-project] Getting quotas for project 7c75c2950e404f30a744aa19b5caf87c. Resources: {'instances', 'cores', 'ram'} {{(pid=94358) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 21 10:38:20.849005 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_db.sqlalchemy.engines [None req-fffb15cc-f8ef-428f-b061-dff546350b57 tempest-AggregatesAdminTestJSON-272408306 tempest-AggregatesAdminTestJSON-272408306-project] Parent process 93484 forked (94357) with an open database connection, which is being discarded and recreated. {{(pid=94357) checkout /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:403}} Apr 21 10:38:20.853011 n-d-811414-3 nova-conductor[94358]: DEBUG nova.quota [None req-44761022-5a2d-4631-b64d-f28b223c038f tempest-DeleteServersAdminTestJSON-583588343 tempest-DeleteServersAdminTestJSON-583588343-project] Getting quotas for user cede120124d540beb12bcb1c7c0d5236 and project 7c75c2950e404f30a744aa19b5caf87c. Resources: {'instances', 'cores', 'ram'} {{(pid=94358) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 21 10:38:20.896760 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-44761022-5a2d-4631-b64d-f28b223c038f tempest-DeleteServersAdminTestJSON-583588343 tempest-DeleteServersAdminTestJSON-583588343-project] [instance: 655cc58d-6330-47e2-8277-7d7ddf1e014d] Selected host: n-h2-811414-3; Selected node: n-h2-811414-3; Alternates: [('n-h1-811414-3', 'n-h1-811414-3')] {{(pid=94358) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 21 10:38:20.904991 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-44761022-5a2d-4631-b64d-f28b223c038f tempest-DeleteServersAdminTestJSON-583588343 tempest-DeleteServersAdminTestJSON-583588343-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:38:20.905565 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-44761022-5a2d-4631-b64d-f28b223c038f tempest-DeleteServersAdminTestJSON-583588343 tempest-DeleteServersAdminTestJSON-583588343-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:38:20.944054 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-44761022-5a2d-4631-b64d-f28b223c038f tempest-DeleteServersAdminTestJSON-583588343 tempest-DeleteServersAdminTestJSON-583588343-project] [instance: 655cc58d-6330-47e2-8277-7d7ddf1e014d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f5cdc3d5-9524-4220-a7fc-ab5606975fdb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94358) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 21 10:38:20.950402 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-44761022-5a2d-4631-b64d-f28b223c038f tempest-DeleteServersAdminTestJSON-583588343 tempest-DeleteServersAdminTestJSON-583588343-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:38:20.952240 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-44761022-5a2d-4631-b64d-f28b223c038f tempest-DeleteServersAdminTestJSON-583588343 tempest-DeleteServersAdminTestJSON-583588343-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:38:21.068108 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-44761022-5a2d-4631-b64d-f28b223c038f tempest-DeleteServersAdminTestJSON-583588343 tempest-DeleteServersAdminTestJSON-583588343-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:38:21.068775 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-44761022-5a2d-4631-b64d-f28b223c038f tempest-DeleteServersAdminTestJSON-583588343 tempest-DeleteServersAdminTestJSON-583588343-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:38:21.069426 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-44761022-5a2d-4631-b64d-f28b223c038f tempest-DeleteServersAdminTestJSON-583588343 tempest-DeleteServersAdminTestJSON-583588343-project] Acquired lock "compute-rpcapi-router" {{(pid=94358) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:266}} Apr 21 10:38:21.073170 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-175ee735-7b49-4ca5-b2b4-1daf8395dc8e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:38:21.073609 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-175ee735-7b49-4ca5-b2b4-1daf8395dc8e None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:38:21.074329 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-175ee735-7b49-4ca5-b2b4-1daf8395dc8e None None] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:38:21.081076 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-175ee735-7b49-4ca5-b2b4-1daf8395dc8e None None] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:38:21.109676 n-d-811414-3 nova-conductor[94358]: INFO nova.compute.rpcapi [None req-175ee735-7b49-4ca5-b2b4-1daf8395dc8e None None] Automatically selected compute RPC version 6.0 from minimum service version 56 Apr 21 10:38:21.110682 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-175ee735-7b49-4ca5-b2b4-1daf8395dc8e None None] Releasing lock "compute-rpcapi-router" {{(pid=94358) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:282}} Apr 21 10:38:21.628972 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-fffb15cc-f8ef-428f-b061-dff546350b57 tempest-AggregatesAdminTestJSON-272408306 tempest-AggregatesAdminTestJSON-272408306-project] Took 0.75 seconds to select destinations for 1 instance(s). {{(pid=94357) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 21 10:38:21.712874 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-fffb15cc-f8ef-428f-b061-dff546350b57 tempest-AggregatesAdminTestJSON-272408306 tempest-AggregatesAdminTestJSON-272408306-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:38:21.716261 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-fffb15cc-f8ef-428f-b061-dff546350b57 tempest-AggregatesAdminTestJSON-272408306 tempest-AggregatesAdminTestJSON-272408306-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:38:21.746924 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_db.sqlalchemy.engines [None req-fffb15cc-f8ef-428f-b061-dff546350b57 tempest-AggregatesAdminTestJSON-272408306 tempest-AggregatesAdminTestJSON-272408306-project] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=94357) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Apr 21 10:38:21.939140 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-fffb15cc-f8ef-428f-b061-dff546350b57 tempest-AggregatesAdminTestJSON-272408306 tempest-AggregatesAdminTestJSON-272408306-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:38:21.940734 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-fffb15cc-f8ef-428f-b061-dff546350b57 tempest-AggregatesAdminTestJSON-272408306 tempest-AggregatesAdminTestJSON-272408306-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:38:21.943104 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-fffb15cc-f8ef-428f-b061-dff546350b57 tempest-AggregatesAdminTestJSON-272408306 tempest-AggregatesAdminTestJSON-272408306-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:38:21.944876 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-fffb15cc-f8ef-428f-b061-dff546350b57 tempest-AggregatesAdminTestJSON-272408306 tempest-AggregatesAdminTestJSON-272408306-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:38:21.989671 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_db.sqlalchemy.engines [None req-fffb15cc-f8ef-428f-b061-dff546350b57 tempest-AggregatesAdminTestJSON-272408306 tempest-AggregatesAdminTestJSON-272408306-project] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=94357) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Apr 21 10:38:22.021433 n-d-811414-3 nova-conductor[94357]: DEBUG nova.quota [None req-fffb15cc-f8ef-428f-b061-dff546350b57 tempest-AggregatesAdminTestJSON-272408306 tempest-AggregatesAdminTestJSON-272408306-project] Getting quotas for project 3b86d27a2b1246f2b0523adb4419b995. Resources: {'instances', 'cores', 'ram'} {{(pid=94357) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 21 10:38:22.029693 n-d-811414-3 nova-conductor[94357]: DEBUG nova.quota [None req-fffb15cc-f8ef-428f-b061-dff546350b57 tempest-AggregatesAdminTestJSON-272408306 tempest-AggregatesAdminTestJSON-272408306-project] Getting quotas for user 967eea5c8c404107adb1caeac3a3264e and project 3b86d27a2b1246f2b0523adb4419b995. Resources: {'instances', 'cores', 'ram'} {{(pid=94357) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 21 10:38:22.046764 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-fffb15cc-f8ef-428f-b061-dff546350b57 tempest-AggregatesAdminTestJSON-272408306 tempest-AggregatesAdminTestJSON-272408306-project] [instance: 9790f10f-6acf-4e6e-9c3c-dd8fcf3ddb35] Selected host: n-h2-811414-3; Selected node: n-h2-811414-3; Alternates: [] {{(pid=94357) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 21 10:38:22.062513 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-fffb15cc-f8ef-428f-b061-dff546350b57 tempest-AggregatesAdminTestJSON-272408306 tempest-AggregatesAdminTestJSON-272408306-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:38:22.064798 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-fffb15cc-f8ef-428f-b061-dff546350b57 tempest-AggregatesAdminTestJSON-272408306 tempest-AggregatesAdminTestJSON-272408306-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:38:22.082583 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-fffb15cc-f8ef-428f-b061-dff546350b57 tempest-AggregatesAdminTestJSON-272408306 tempest-AggregatesAdminTestJSON-272408306-project] [instance: 9790f10f-6acf-4e6e-9c3c-dd8fcf3ddb35] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f5cdc3d5-9524-4220-a7fc-ab5606975fdb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94357) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 21 10:38:22.088062 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-fffb15cc-f8ef-428f-b061-dff546350b57 tempest-AggregatesAdminTestJSON-272408306 tempest-AggregatesAdminTestJSON-272408306-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:38:22.088498 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-fffb15cc-f8ef-428f-b061-dff546350b57 tempest-AggregatesAdminTestJSON-272408306 tempest-AggregatesAdminTestJSON-272408306-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:38:22.168897 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-fffb15cc-f8ef-428f-b061-dff546350b57 tempest-AggregatesAdminTestJSON-272408306 tempest-AggregatesAdminTestJSON-272408306-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:38:22.169412 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-fffb15cc-f8ef-428f-b061-dff546350b57 tempest-AggregatesAdminTestJSON-272408306 tempest-AggregatesAdminTestJSON-272408306-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:38:22.169984 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-fffb15cc-f8ef-428f-b061-dff546350b57 tempest-AggregatesAdminTestJSON-272408306 tempest-AggregatesAdminTestJSON-272408306-project] Acquired lock "compute-rpcapi-router" {{(pid=94357) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:266}} Apr 21 10:38:22.172371 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-447d99c0-3545-4e52-841c-77556e8df041 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:38:22.173625 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-447d99c0-3545-4e52-841c-77556e8df041 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:38:22.175755 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-447d99c0-3545-4e52-841c-77556e8df041 None None] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:38:22.176812 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-447d99c0-3545-4e52-841c-77556e8df041 None None] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:38:22.199577 n-d-811414-3 nova-conductor[94357]: INFO nova.compute.rpcapi [None req-447d99c0-3545-4e52-841c-77556e8df041 None None] Automatically selected compute RPC version 6.0 from minimum service version 56 Apr 21 10:38:22.200653 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-447d99c0-3545-4e52-841c-77556e8df041 None None] Releasing lock "compute-rpcapi-router" {{(pid=94357) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:282}} Apr 21 10:38:32.656459 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-c65c268f-a367-42ae-91b9-2c713cb87d01 tempest-ServersAdmin275Test-763242820 tempest-ServersAdmin275Test-763242820-project] Took 0.67 seconds to select destinations for 1 instance(s). {{(pid=94358) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 21 10:38:32.717491 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-c65c268f-a367-42ae-91b9-2c713cb87d01 tempest-ServersAdmin275Test-763242820 tempest-ServersAdmin275Test-763242820-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:38:32.718166 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-c65c268f-a367-42ae-91b9-2c713cb87d01 tempest-ServersAdmin275Test-763242820 tempest-ServersAdmin275Test-763242820-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:38:32.875174 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-c65c268f-a367-42ae-91b9-2c713cb87d01 tempest-ServersAdmin275Test-763242820 tempest-ServersAdmin275Test-763242820-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:38:32.875591 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-c65c268f-a367-42ae-91b9-2c713cb87d01 tempest-ServersAdmin275Test-763242820 tempest-ServersAdmin275Test-763242820-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:38:32.876318 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-c65c268f-a367-42ae-91b9-2c713cb87d01 tempest-ServersAdmin275Test-763242820 tempest-ServersAdmin275Test-763242820-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:38:32.876756 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-c65c268f-a367-42ae-91b9-2c713cb87d01 tempest-ServersAdmin275Test-763242820 tempest-ServersAdmin275Test-763242820-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:38:32.929621 n-d-811414-3 nova-conductor[94358]: DEBUG nova.quota [None req-c65c268f-a367-42ae-91b9-2c713cb87d01 tempest-ServersAdmin275Test-763242820 tempest-ServersAdmin275Test-763242820-project] Getting quotas for project 4168664f0a264c23beca19d653b4ad70. Resources: {'instances', 'cores', 'ram'} {{(pid=94358) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 21 10:38:32.937391 n-d-811414-3 nova-conductor[94358]: DEBUG nova.quota [None req-c65c268f-a367-42ae-91b9-2c713cb87d01 tempest-ServersAdmin275Test-763242820 tempest-ServersAdmin275Test-763242820-project] Getting quotas for user 509843b62514445a88d0fd80b86d5652 and project 4168664f0a264c23beca19d653b4ad70. Resources: {'instances', 'cores', 'ram'} {{(pid=94358) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 21 10:38:32.951360 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-c65c268f-a367-42ae-91b9-2c713cb87d01 tempest-ServersAdmin275Test-763242820 tempest-ServersAdmin275Test-763242820-project] [instance: f4a67c2d-9d87-443c-8b13-6dc129fe446e] Selected host: n-h1-811414-3; Selected node: n-h1-811414-3; Alternates: [('n-h2-811414-3', 'n-h2-811414-3')] {{(pid=94358) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 21 10:38:32.952307 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-c65c268f-a367-42ae-91b9-2c713cb87d01 tempest-ServersAdmin275Test-763242820 tempest-ServersAdmin275Test-763242820-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:38:32.952910 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-c65c268f-a367-42ae-91b9-2c713cb87d01 tempest-ServersAdmin275Test-763242820 tempest-ServersAdmin275Test-763242820-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:38:32.970254 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-c65c268f-a367-42ae-91b9-2c713cb87d01 tempest-ServersAdmin275Test-763242820 tempest-ServersAdmin275Test-763242820-project] [instance: f4a67c2d-9d87-443c-8b13-6dc129fe446e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f5cdc3d5-9524-4220-a7fc-ab5606975fdb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94358) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 21 10:38:32.972126 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-c65c268f-a367-42ae-91b9-2c713cb87d01 tempest-ServersAdmin275Test-763242820 tempest-ServersAdmin275Test-763242820-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:38:32.973297 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-c65c268f-a367-42ae-91b9-2c713cb87d01 tempest-ServersAdmin275Test-763242820 tempest-ServersAdmin275Test-763242820-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:38:33.077699 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-c65c268f-a367-42ae-91b9-2c713cb87d01 tempest-ServersAdmin275Test-763242820 tempest-ServersAdmin275Test-763242820-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:38:33.078566 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-c65c268f-a367-42ae-91b9-2c713cb87d01 tempest-ServersAdmin275Test-763242820 tempest-ServersAdmin275Test-763242820-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:38:51.266259 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-9f5dfb35-5f4a-4a3d-8bde-e24c32528601 tempest-ServersAdmin275Test-763242820 tempest-ServersAdmin275Test-763242820-project] Targeting cell 6c99d8ec-fb48-48af-b02b-a629a7c2cb6b(cell1) for conductor method rebuild_instance {{(pid=94357) wrapper /opt/stack/nova/nova/conductor/manager.py:91}} Apr 21 10:38:51.266799 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-9f5dfb35-5f4a-4a3d-8bde-e24c32528601 tempest-ServersAdmin275Test-763242820 tempest-ServersAdmin275Test-763242820-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:38:51.267218 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-9f5dfb35-5f4a-4a3d-8bde-e24c32528601 tempest-ServersAdmin275Test-763242820 tempest-ServersAdmin275Test-763242820-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:38:51.325780 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-9f5dfb35-5f4a-4a3d-8bde-e24c32528601 tempest-ServersAdmin275Test-763242820 tempest-ServersAdmin275Test-763242820-project] [instance: f4a67c2d-9d87-443c-8b13-6dc129fe446e] No migration record for the rebuild/evacuate request. {{(pid=94357) rebuild_instance /opt/stack/nova/nova/conductor/manager.py:1101}} Apr 21 10:38:54.851569 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-efda5958-6038-4d9c-add0-e299fff658f6 tempest-ServersWithSpecificFlavorTestJSON-993972204 tempest-ServersWithSpecificFlavorTestJSON-993972204-project] Took 0.42 seconds to select destinations for 1 instance(s). {{(pid=94358) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 21 10:38:54.904341 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-efda5958-6038-4d9c-add0-e299fff658f6 tempest-ServersWithSpecificFlavorTestJSON-993972204 tempest-ServersWithSpecificFlavorTestJSON-993972204-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:38:54.904777 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-efda5958-6038-4d9c-add0-e299fff658f6 tempest-ServersWithSpecificFlavorTestJSON-993972204 tempest-ServersWithSpecificFlavorTestJSON-993972204-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:38:54.979794 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-efda5958-6038-4d9c-add0-e299fff658f6 tempest-ServersWithSpecificFlavorTestJSON-993972204 tempest-ServersWithSpecificFlavorTestJSON-993972204-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:38:54.980666 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-efda5958-6038-4d9c-add0-e299fff658f6 tempest-ServersWithSpecificFlavorTestJSON-993972204 tempest-ServersWithSpecificFlavorTestJSON-993972204-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:38:54.982299 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-efda5958-6038-4d9c-add0-e299fff658f6 tempest-ServersWithSpecificFlavorTestJSON-993972204 tempest-ServersWithSpecificFlavorTestJSON-993972204-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:38:54.984354 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-efda5958-6038-4d9c-add0-e299fff658f6 tempest-ServersWithSpecificFlavorTestJSON-993972204 tempest-ServersWithSpecificFlavorTestJSON-993972204-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:38:55.006437 n-d-811414-3 nova-conductor[94358]: DEBUG nova.quota [None req-efda5958-6038-4d9c-add0-e299fff658f6 tempest-ServersWithSpecificFlavorTestJSON-993972204 tempest-ServersWithSpecificFlavorTestJSON-993972204-project] Getting quotas for project ac45715479a44120883bd084d7e36fe1. Resources: {'instances', 'cores', 'ram'} {{(pid=94358) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 21 10:38:55.011556 n-d-811414-3 nova-conductor[94358]: DEBUG nova.quota [None req-efda5958-6038-4d9c-add0-e299fff658f6 tempest-ServersWithSpecificFlavorTestJSON-993972204 tempest-ServersWithSpecificFlavorTestJSON-993972204-project] Getting quotas for user e0a26102868d4f5b8af642cbf4125a18 and project ac45715479a44120883bd084d7e36fe1. Resources: {'instances', 'cores', 'ram'} {{(pid=94358) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 21 10:38:55.024281 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-efda5958-6038-4d9c-add0-e299fff658f6 tempest-ServersWithSpecificFlavorTestJSON-993972204 tempest-ServersWithSpecificFlavorTestJSON-993972204-project] [instance: c66b261f-b05d-4766-b34a-1c57e390f7ad] Selected host: n-h1-811414-3; Selected node: n-h1-811414-3; Alternates: [('n-h2-811414-3', 'n-h2-811414-3')] {{(pid=94358) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 21 10:38:55.025846 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-efda5958-6038-4d9c-add0-e299fff658f6 tempest-ServersWithSpecificFlavorTestJSON-993972204 tempest-ServersWithSpecificFlavorTestJSON-993972204-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:38:55.026429 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-efda5958-6038-4d9c-add0-e299fff658f6 tempest-ServersWithSpecificFlavorTestJSON-993972204 tempest-ServersWithSpecificFlavorTestJSON-993972204-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:38:55.037593 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-efda5958-6038-4d9c-add0-e299fff658f6 tempest-ServersWithSpecificFlavorTestJSON-993972204 tempest-ServersWithSpecificFlavorTestJSON-993972204-project] [instance: c66b261f-b05d-4766-b34a-1c57e390f7ad] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f5cdc3d5-9524-4220-a7fc-ab5606975fdb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94358) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 21 10:38:55.039933 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-efda5958-6038-4d9c-add0-e299fff658f6 tempest-ServersWithSpecificFlavorTestJSON-993972204 tempest-ServersWithSpecificFlavorTestJSON-993972204-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:38:55.040702 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-efda5958-6038-4d9c-add0-e299fff658f6 tempest-ServersWithSpecificFlavorTestJSON-993972204 tempest-ServersWithSpecificFlavorTestJSON-993972204-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:38:55.091774 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-efda5958-6038-4d9c-add0-e299fff658f6 tempest-ServersWithSpecificFlavorTestJSON-993972204 tempest-ServersWithSpecificFlavorTestJSON-993972204-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:38:55.092714 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-efda5958-6038-4d9c-add0-e299fff658f6 tempest-ServersWithSpecificFlavorTestJSON-993972204 tempest-ServersWithSpecificFlavorTestJSON-993972204-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:38:59.713506 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-79981718-734c-46c5-95cf-94f8c2d80e64 tempest-LiveMigrationNegativeTest-1542274708 tempest-LiveMigrationNegativeTest-1542274708-project] Took 0.41 seconds to select destinations for 1 instance(s). {{(pid=94357) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 21 10:38:59.757987 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-79981718-734c-46c5-95cf-94f8c2d80e64 tempest-LiveMigrationNegativeTest-1542274708 tempest-LiveMigrationNegativeTest-1542274708-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:38:59.758389 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-79981718-734c-46c5-95cf-94f8c2d80e64 tempest-LiveMigrationNegativeTest-1542274708 tempest-LiveMigrationNegativeTest-1542274708-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:38:59.842494 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-79981718-734c-46c5-95cf-94f8c2d80e64 tempest-LiveMigrationNegativeTest-1542274708 tempest-LiveMigrationNegativeTest-1542274708-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:38:59.842898 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-79981718-734c-46c5-95cf-94f8c2d80e64 tempest-LiveMigrationNegativeTest-1542274708 tempest-LiveMigrationNegativeTest-1542274708-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:38:59.844109 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-79981718-734c-46c5-95cf-94f8c2d80e64 tempest-LiveMigrationNegativeTest-1542274708 tempest-LiveMigrationNegativeTest-1542274708-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:38:59.844846 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-79981718-734c-46c5-95cf-94f8c2d80e64 tempest-LiveMigrationNegativeTest-1542274708 tempest-LiveMigrationNegativeTest-1542274708-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:38:59.877316 n-d-811414-3 nova-conductor[94357]: DEBUG nova.quota [None req-79981718-734c-46c5-95cf-94f8c2d80e64 tempest-LiveMigrationNegativeTest-1542274708 tempest-LiveMigrationNegativeTest-1542274708-project] Getting quotas for project 58807ad40cf942bfb1567bf743a048b8. Resources: {'instances', 'cores', 'ram'} {{(pid=94357) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 21 10:38:59.886595 n-d-811414-3 nova-conductor[94357]: DEBUG nova.quota [None req-79981718-734c-46c5-95cf-94f8c2d80e64 tempest-LiveMigrationNegativeTest-1542274708 tempest-LiveMigrationNegativeTest-1542274708-project] Getting quotas for user 3a867b4ee8a2498c92f98d0d765bb366 and project 58807ad40cf942bfb1567bf743a048b8. Resources: {'instances', 'cores', 'ram'} {{(pid=94357) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 21 10:38:59.910851 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-79981718-734c-46c5-95cf-94f8c2d80e64 tempest-LiveMigrationNegativeTest-1542274708 tempest-LiveMigrationNegativeTest-1542274708-project] [instance: 5551a137-e05a-4d60-a6b0-a4eeca5911e1] Selected host: n-h2-811414-3; Selected node: n-h2-811414-3; Alternates: [('n-h1-811414-3', 'n-h1-811414-3')] {{(pid=94357) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 21 10:38:59.911781 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-79981718-734c-46c5-95cf-94f8c2d80e64 tempest-LiveMigrationNegativeTest-1542274708 tempest-LiveMigrationNegativeTest-1542274708-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:38:59.912182 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-79981718-734c-46c5-95cf-94f8c2d80e64 tempest-LiveMigrationNegativeTest-1542274708 tempest-LiveMigrationNegativeTest-1542274708-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:38:59.935628 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-79981718-734c-46c5-95cf-94f8c2d80e64 tempest-LiveMigrationNegativeTest-1542274708 tempest-LiveMigrationNegativeTest-1542274708-project] [instance: 5551a137-e05a-4d60-a6b0-a4eeca5911e1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f5cdc3d5-9524-4220-a7fc-ab5606975fdb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94357) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 21 10:38:59.937246 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-79981718-734c-46c5-95cf-94f8c2d80e64 tempest-LiveMigrationNegativeTest-1542274708 tempest-LiveMigrationNegativeTest-1542274708-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:38:59.937646 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-79981718-734c-46c5-95cf-94f8c2d80e64 tempest-LiveMigrationNegativeTest-1542274708 tempest-LiveMigrationNegativeTest-1542274708-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:39:00.000142 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-79981718-734c-46c5-95cf-94f8c2d80e64 tempest-LiveMigrationNegativeTest-1542274708 tempest-LiveMigrationNegativeTest-1542274708-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:39:00.000810 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-79981718-734c-46c5-95cf-94f8c2d80e64 tempest-LiveMigrationNegativeTest-1542274708 tempest-LiveMigrationNegativeTest-1542274708-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:39:01.812504 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-f1f7b7db-ab10-4bef-b926-f6a37a6f1969 tempest-DeleteServersAdminTestJSON-583588343 tempest-DeleteServersAdminTestJSON-583588343-project] Took 0.28 seconds to select destinations for 1 instance(s). {{(pid=94358) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 21 10:39:01.868851 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-f1f7b7db-ab10-4bef-b926-f6a37a6f1969 tempest-DeleteServersAdminTestJSON-583588343 tempest-DeleteServersAdminTestJSON-583588343-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:39:01.870021 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-f1f7b7db-ab10-4bef-b926-f6a37a6f1969 tempest-DeleteServersAdminTestJSON-583588343 tempest-DeleteServersAdminTestJSON-583588343-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:39:01.985632 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-f1f7b7db-ab10-4bef-b926-f6a37a6f1969 tempest-DeleteServersAdminTestJSON-583588343 tempest-DeleteServersAdminTestJSON-583588343-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:39:01.989751 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-f1f7b7db-ab10-4bef-b926-f6a37a6f1969 tempest-DeleteServersAdminTestJSON-583588343 tempest-DeleteServersAdminTestJSON-583588343-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:39:01.990757 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-f1f7b7db-ab10-4bef-b926-f6a37a6f1969 tempest-DeleteServersAdminTestJSON-583588343 tempest-DeleteServersAdminTestJSON-583588343-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:39:01.991307 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-f1f7b7db-ab10-4bef-b926-f6a37a6f1969 tempest-DeleteServersAdminTestJSON-583588343 tempest-DeleteServersAdminTestJSON-583588343-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:39:02.027075 n-d-811414-3 nova-conductor[94358]: DEBUG nova.quota [None req-f1f7b7db-ab10-4bef-b926-f6a37a6f1969 tempest-DeleteServersAdminTestJSON-583588343 tempest-DeleteServersAdminTestJSON-583588343-project] Getting quotas for project 7c75c2950e404f30a744aa19b5caf87c. Resources: {'instances', 'cores', 'ram'} {{(pid=94358) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 21 10:39:02.035311 n-d-811414-3 nova-conductor[94358]: DEBUG nova.quota [None req-f1f7b7db-ab10-4bef-b926-f6a37a6f1969 tempest-DeleteServersAdminTestJSON-583588343 tempest-DeleteServersAdminTestJSON-583588343-project] Getting quotas for user cede120124d540beb12bcb1c7c0d5236 and project 7c75c2950e404f30a744aa19b5caf87c. Resources: {'instances', 'cores', 'ram'} {{(pid=94358) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 21 10:39:02.058669 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-f1f7b7db-ab10-4bef-b926-f6a37a6f1969 tempest-DeleteServersAdminTestJSON-583588343 tempest-DeleteServersAdminTestJSON-583588343-project] [instance: 2ad3b884-e2cb-44bc-ac30-00603423f9e6] Selected host: n-h2-811414-3; Selected node: n-h2-811414-3; Alternates: [('n-h1-811414-3', 'n-h1-811414-3')] {{(pid=94358) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 21 10:39:02.059641 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-f1f7b7db-ab10-4bef-b926-f6a37a6f1969 tempest-DeleteServersAdminTestJSON-583588343 tempest-DeleteServersAdminTestJSON-583588343-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:39:02.060043 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-f1f7b7db-ab10-4bef-b926-f6a37a6f1969 tempest-DeleteServersAdminTestJSON-583588343 tempest-DeleteServersAdminTestJSON-583588343-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:39:02.076490 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-f1f7b7db-ab10-4bef-b926-f6a37a6f1969 tempest-DeleteServersAdminTestJSON-583588343 tempest-DeleteServersAdminTestJSON-583588343-project] [instance: 2ad3b884-e2cb-44bc-ac30-00603423f9e6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f5cdc3d5-9524-4220-a7fc-ab5606975fdb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94358) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 21 10:39:02.078314 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-f1f7b7db-ab10-4bef-b926-f6a37a6f1969 tempest-DeleteServersAdminTestJSON-583588343 tempest-DeleteServersAdminTestJSON-583588343-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:39:02.078899 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-f1f7b7db-ab10-4bef-b926-f6a37a6f1969 tempest-DeleteServersAdminTestJSON-583588343 tempest-DeleteServersAdminTestJSON-583588343-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:39:02.151788 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-f1f7b7db-ab10-4bef-b926-f6a37a6f1969 tempest-DeleteServersAdminTestJSON-583588343 tempest-DeleteServersAdminTestJSON-583588343-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:39:02.152097 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-f1f7b7db-ab10-4bef-b926-f6a37a6f1969 tempest-DeleteServersAdminTestJSON-583588343 tempest-DeleteServersAdminTestJSON-583588343-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:39:12.573411 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-b0ad52eb-b947-460d-96a0-1b9fc4860101 tempest-LiveMigrationTest-854730834 tempest-LiveMigrationTest-854730834-project] Took 0.38 seconds to select destinations for 1 instance(s). {{(pid=94357) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 21 10:39:12.620417 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-b0ad52eb-b947-460d-96a0-1b9fc4860101 tempest-LiveMigrationTest-854730834 tempest-LiveMigrationTest-854730834-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:39:12.622611 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-b0ad52eb-b947-460d-96a0-1b9fc4860101 tempest-LiveMigrationTest-854730834 tempest-LiveMigrationTest-854730834-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:39:12.712425 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-b0ad52eb-b947-460d-96a0-1b9fc4860101 tempest-LiveMigrationTest-854730834 tempest-LiveMigrationTest-854730834-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:39:12.714157 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-b0ad52eb-b947-460d-96a0-1b9fc4860101 tempest-LiveMigrationTest-854730834 tempest-LiveMigrationTest-854730834-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:39:12.714904 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-b0ad52eb-b947-460d-96a0-1b9fc4860101 tempest-LiveMigrationTest-854730834 tempest-LiveMigrationTest-854730834-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:39:12.715353 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-b0ad52eb-b947-460d-96a0-1b9fc4860101 tempest-LiveMigrationTest-854730834 tempest-LiveMigrationTest-854730834-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:39:12.754384 n-d-811414-3 nova-conductor[94357]: DEBUG nova.quota [None req-b0ad52eb-b947-460d-96a0-1b9fc4860101 tempest-LiveMigrationTest-854730834 tempest-LiveMigrationTest-854730834-project] Getting quotas for project 827d444119b94ef6a099b8cf4c6a10ba. Resources: {'instances', 'cores', 'ram'} {{(pid=94357) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 21 10:39:12.760498 n-d-811414-3 nova-conductor[94357]: DEBUG nova.quota [None req-b0ad52eb-b947-460d-96a0-1b9fc4860101 tempest-LiveMigrationTest-854730834 tempest-LiveMigrationTest-854730834-project] Getting quotas for user 8b0079bf33b34e3cb121c2ea48a694fc and project 827d444119b94ef6a099b8cf4c6a10ba. Resources: {'instances', 'cores', 'ram'} {{(pid=94357) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 21 10:39:12.787592 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-b0ad52eb-b947-460d-96a0-1b9fc4860101 tempest-LiveMigrationTest-854730834 tempest-LiveMigrationTest-854730834-project] [instance: 9762a487-917a-42f8-ab94-04780a8d678c] Selected host: n-h1-811414-3; Selected node: n-h1-811414-3; Alternates: [('n-h2-811414-3', 'n-h2-811414-3')] {{(pid=94357) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 21 10:39:12.790925 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-b0ad52eb-b947-460d-96a0-1b9fc4860101 tempest-LiveMigrationTest-854730834 tempest-LiveMigrationTest-854730834-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:39:12.790925 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-b0ad52eb-b947-460d-96a0-1b9fc4860101 tempest-LiveMigrationTest-854730834 tempest-LiveMigrationTest-854730834-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:39:12.803725 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-b0ad52eb-b947-460d-96a0-1b9fc4860101 tempest-LiveMigrationTest-854730834 tempest-LiveMigrationTest-854730834-project] [instance: 9762a487-917a-42f8-ab94-04780a8d678c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f5cdc3d5-9524-4220-a7fc-ab5606975fdb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94357) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 21 10:39:12.805146 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-b0ad52eb-b947-460d-96a0-1b9fc4860101 tempest-LiveMigrationTest-854730834 tempest-LiveMigrationTest-854730834-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:39:12.805653 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-b0ad52eb-b947-460d-96a0-1b9fc4860101 tempest-LiveMigrationTest-854730834 tempest-LiveMigrationTest-854730834-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:39:12.858127 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-b0ad52eb-b947-460d-96a0-1b9fc4860101 tempest-LiveMigrationTest-854730834 tempest-LiveMigrationTest-854730834-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:39:12.858745 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-b0ad52eb-b947-460d-96a0-1b9fc4860101 tempest-LiveMigrationTest-854730834 tempest-LiveMigrationTest-854730834-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:39:18.228249 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-7d302138-b700-4be2-b0e0-bc0eef2921b4 tempest-LiveMigrationNegativeTest-1542274708 tempest-LiveMigrationNegativeTest-1542274708-project] Took 0.44 seconds to select destinations for 1 instance(s). {{(pid=94358) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 21 10:39:18.295740 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-7d302138-b700-4be2-b0e0-bc0eef2921b4 tempest-LiveMigrationNegativeTest-1542274708 tempest-LiveMigrationNegativeTest-1542274708-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:39:18.297205 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-7d302138-b700-4be2-b0e0-bc0eef2921b4 tempest-LiveMigrationNegativeTest-1542274708 tempest-LiveMigrationNegativeTest-1542274708-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:39:18.405581 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-7d302138-b700-4be2-b0e0-bc0eef2921b4 tempest-LiveMigrationNegativeTest-1542274708 tempest-LiveMigrationNegativeTest-1542274708-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:39:18.408225 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-7d302138-b700-4be2-b0e0-bc0eef2921b4 tempest-LiveMigrationNegativeTest-1542274708 tempest-LiveMigrationNegativeTest-1542274708-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:39:18.409273 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-7d302138-b700-4be2-b0e0-bc0eef2921b4 tempest-LiveMigrationNegativeTest-1542274708 tempest-LiveMigrationNegativeTest-1542274708-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:39:18.411766 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-7d302138-b700-4be2-b0e0-bc0eef2921b4 tempest-LiveMigrationNegativeTest-1542274708 tempest-LiveMigrationNegativeTest-1542274708-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:39:18.459281 n-d-811414-3 nova-conductor[94358]: DEBUG nova.quota [None req-7d302138-b700-4be2-b0e0-bc0eef2921b4 tempest-LiveMigrationNegativeTest-1542274708 tempest-LiveMigrationNegativeTest-1542274708-project] Getting quotas for project 58807ad40cf942bfb1567bf743a048b8. Resources: {'instances', 'cores', 'ram'} {{(pid=94358) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 21 10:39:18.465475 n-d-811414-3 nova-conductor[94358]: DEBUG nova.quota [None req-7d302138-b700-4be2-b0e0-bc0eef2921b4 tempest-LiveMigrationNegativeTest-1542274708 tempest-LiveMigrationNegativeTest-1542274708-project] Getting quotas for user 3a867b4ee8a2498c92f98d0d765bb366 and project 58807ad40cf942bfb1567bf743a048b8. Resources: {'instances', 'cores', 'ram'} {{(pid=94358) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 21 10:39:18.476579 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-7d302138-b700-4be2-b0e0-bc0eef2921b4 tempest-LiveMigrationNegativeTest-1542274708 tempest-LiveMigrationNegativeTest-1542274708-project] [instance: 2dc1df5b-6b97-4e4b-8fe0-0d04542f89e0] Selected host: n-h2-811414-3; Selected node: n-h2-811414-3; Alternates: [('n-h1-811414-3', 'n-h1-811414-3')] {{(pid=94358) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 21 10:39:18.477805 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-7d302138-b700-4be2-b0e0-bc0eef2921b4 tempest-LiveMigrationNegativeTest-1542274708 tempest-LiveMigrationNegativeTest-1542274708-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:39:18.478340 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-7d302138-b700-4be2-b0e0-bc0eef2921b4 tempest-LiveMigrationNegativeTest-1542274708 tempest-LiveMigrationNegativeTest-1542274708-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:39:18.486533 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-7d302138-b700-4be2-b0e0-bc0eef2921b4 tempest-LiveMigrationNegativeTest-1542274708 tempest-LiveMigrationNegativeTest-1542274708-project] [instance: 2dc1df5b-6b97-4e4b-8fe0-0d04542f89e0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f5cdc3d5-9524-4220-a7fc-ab5606975fdb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94358) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 21 10:39:18.488454 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-7d302138-b700-4be2-b0e0-bc0eef2921b4 tempest-LiveMigrationNegativeTest-1542274708 tempest-LiveMigrationNegativeTest-1542274708-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:39:18.489098 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-7d302138-b700-4be2-b0e0-bc0eef2921b4 tempest-LiveMigrationNegativeTest-1542274708 tempest-LiveMigrationNegativeTest-1542274708-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:39:18.525684 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-7d302138-b700-4be2-b0e0-bc0eef2921b4 tempest-LiveMigrationNegativeTest-1542274708 tempest-LiveMigrationNegativeTest-1542274708-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:39:18.526593 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-7d302138-b700-4be2-b0e0-bc0eef2921b4 tempest-LiveMigrationNegativeTest-1542274708 tempest-LiveMigrationNegativeTest-1542274708-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:39:24.542894 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-259b1af2-7f04-463b-956b-81222fae5ce8 tempest-ServersAdmin275Test-1125974416 tempest-ServersAdmin275Test-1125974416-project-admin] Targeting cell 6c99d8ec-fb48-48af-b02b-a629a7c2cb6b(cell1) for conductor method rebuild_instance {{(pid=94357) wrapper /opt/stack/nova/nova/conductor/manager.py:91}} Apr 21 10:39:24.543472 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-259b1af2-7f04-463b-956b-81222fae5ce8 tempest-ServersAdmin275Test-1125974416 tempest-ServersAdmin275Test-1125974416-project-admin] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:39:24.546065 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-259b1af2-7f04-463b-956b-81222fae5ce8 tempest-ServersAdmin275Test-1125974416 tempest-ServersAdmin275Test-1125974416-project-admin] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:39:24.572339 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-259b1af2-7f04-463b-956b-81222fae5ce8 tempest-ServersAdmin275Test-1125974416 tempest-ServersAdmin275Test-1125974416-project-admin] [instance: f4a67c2d-9d87-443c-8b13-6dc129fe446e] No migration record for the rebuild/evacuate request. {{(pid=94357) rebuild_instance /opt/stack/nova/nova/conductor/manager.py:1101}} Apr 21 10:39:30.389225 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-178931de-f951-48fe-aa51-79c8e76faaf6 tempest-LiveMigrationTest-1685226576 tempest-LiveMigrationTest-1685226576-project-admin] Targeting cell 6c99d8ec-fb48-48af-b02b-a629a7c2cb6b(cell1) for conductor method migrate_server {{(pid=94358) wrapper /opt/stack/nova/nova/conductor/manager.py:91}} Apr 21 10:39:30.390327 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-178931de-f951-48fe-aa51-79c8e76faaf6 tempest-LiveMigrationTest-1685226576 tempest-LiveMigrationTest-1685226576-project-admin] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:39:30.391226 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-178931de-f951-48fe-aa51-79c8e76faaf6 tempest-LiveMigrationTest-1685226576 tempest-LiveMigrationTest-1685226576-project-admin] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:39:31.418629 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.tasks.migrate [None req-178931de-f951-48fe-aa51-79c8e76faaf6 tempest-LiveMigrationTest-1685226576 tempest-LiveMigrationTest-1685226576-project-admin] Created allocations for migration 98232c7c-07d7-45f2-905c-6eacc81f4392 on 43480f3a-fb09-463e-8326-6927c98a38b4 {{(pid=94358) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} Apr 21 10:39:31.831343 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-a18a3818-26d9-4ef8-b5de-9c49bfbdb4f1 tempest-ServerDiagnosticsNegativeTest-202360298 tempest-ServerDiagnosticsNegativeTest-202360298-project] Took 0.30 seconds to select destinations for 1 instance(s). {{(pid=94357) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 21 10:39:31.871938 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-a18a3818-26d9-4ef8-b5de-9c49bfbdb4f1 tempest-ServerDiagnosticsNegativeTest-202360298 tempest-ServerDiagnosticsNegativeTest-202360298-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:39:31.874771 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-a18a3818-26d9-4ef8-b5de-9c49bfbdb4f1 tempest-ServerDiagnosticsNegativeTest-202360298 tempest-ServerDiagnosticsNegativeTest-202360298-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:39:31.903364 n-d-811414-3 nova-conductor[94358]: DEBUG nova.scheduler.utils [None req-178931de-f951-48fe-aa51-79c8e76faaf6 tempest-LiveMigrationTest-1685226576 tempest-LiveMigrationTest-1685226576-project-admin] [instance: 9762a487-917a-42f8-ab94-04780a8d678c] Instance allocations successfully created on destination node 6ea3f8b1-0c53-40ba-ba27-f80f78a284a6: {'allocations': {'6ea3f8b1-0c53-40ba-ba27-f80f78a284a6': {'resources': {'VCPU': 1, 'MEMORY_MB': 1024, 'DISK_GB': 1}}}} {{(pid=94358) claim_resources_on_destination /opt/stack/nova/nova/scheduler/utils.py:827}} Apr 21 10:39:31.904124 n-d-811414-3 nova-conductor[94358]: DEBUG nova.objects.instance [None req-178931de-f951-48fe-aa51-79c8e76faaf6 tempest-LiveMigrationTest-1685226576 tempest-LiveMigrationTest-1685226576-project-admin] Lazy-loading 'resources' on Instance uuid 9762a487-917a-42f8-ab94-04780a8d678c {{(pid=94358) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Apr 21 10:39:31.914489 n-d-811414-3 nova-conductor[94358]: DEBUG nova.objects.instance [None req-178931de-f951-48fe-aa51-79c8e76faaf6 tempest-LiveMigrationTest-1685226576 tempest-LiveMigrationTest-1685226576-project-admin] Lazy-loading 'pci_requests' on Instance uuid 9762a487-917a-42f8-ab94-04780a8d678c {{(pid=94358) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Apr 21 10:39:32.005724 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-a18a3818-26d9-4ef8-b5de-9c49bfbdb4f1 tempest-ServerDiagnosticsNegativeTest-202360298 tempest-ServerDiagnosticsNegativeTest-202360298-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:39:32.006140 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-a18a3818-26d9-4ef8-b5de-9c49bfbdb4f1 tempest-ServerDiagnosticsNegativeTest-202360298 tempest-ServerDiagnosticsNegativeTest-202360298-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:39:32.009535 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-a18a3818-26d9-4ef8-b5de-9c49bfbdb4f1 tempest-ServerDiagnosticsNegativeTest-202360298 tempest-ServerDiagnosticsNegativeTest-202360298-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:39:32.009944 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-a18a3818-26d9-4ef8-b5de-9c49bfbdb4f1 tempest-ServerDiagnosticsNegativeTest-202360298 tempest-ServerDiagnosticsNegativeTest-202360298-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:39:32.029252 n-d-811414-3 nova-conductor[94357]: DEBUG nova.quota [None req-a18a3818-26d9-4ef8-b5de-9c49bfbdb4f1 tempest-ServerDiagnosticsNegativeTest-202360298 tempest-ServerDiagnosticsNegativeTest-202360298-project] Getting quotas for project a9201ea7979a442da434788554f36d37. Resources: {'instances', 'cores', 'ram'} {{(pid=94357) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 21 10:39:32.034788 n-d-811414-3 nova-conductor[94357]: DEBUG nova.quota [None req-a18a3818-26d9-4ef8-b5de-9c49bfbdb4f1 tempest-ServerDiagnosticsNegativeTest-202360298 tempest-ServerDiagnosticsNegativeTest-202360298-project] Getting quotas for user 67cca3b17ecd42d282c2f990793cf134 and project a9201ea7979a442da434788554f36d37. Resources: {'instances', 'cores', 'ram'} {{(pid=94357) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 21 10:39:32.045397 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-a18a3818-26d9-4ef8-b5de-9c49bfbdb4f1 tempest-ServerDiagnosticsNegativeTest-202360298 tempest-ServerDiagnosticsNegativeTest-202360298-project] [instance: 03e0a914-26f3-4688-a716-ab275029bcc6] Selected host: n-h2-811414-3; Selected node: n-h2-811414-3; Alternates: [('n-h1-811414-3', 'n-h1-811414-3')] {{(pid=94357) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 21 10:39:32.046366 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-a18a3818-26d9-4ef8-b5de-9c49bfbdb4f1 tempest-ServerDiagnosticsNegativeTest-202360298 tempest-ServerDiagnosticsNegativeTest-202360298-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:39:32.046741 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-a18a3818-26d9-4ef8-b5de-9c49bfbdb4f1 tempest-ServerDiagnosticsNegativeTest-202360298 tempest-ServerDiagnosticsNegativeTest-202360298-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:39:32.058884 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-a18a3818-26d9-4ef8-b5de-9c49bfbdb4f1 tempest-ServerDiagnosticsNegativeTest-202360298 tempest-ServerDiagnosticsNegativeTest-202360298-project] [instance: 03e0a914-26f3-4688-a716-ab275029bcc6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f5cdc3d5-9524-4220-a7fc-ab5606975fdb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94357) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 21 10:39:32.060722 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-a18a3818-26d9-4ef8-b5de-9c49bfbdb4f1 tempest-ServerDiagnosticsNegativeTest-202360298 tempest-ServerDiagnosticsNegativeTest-202360298-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:39:32.061395 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-a18a3818-26d9-4ef8-b5de-9c49bfbdb4f1 tempest-ServerDiagnosticsNegativeTest-202360298 tempest-ServerDiagnosticsNegativeTest-202360298-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:39:32.134034 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-a18a3818-26d9-4ef8-b5de-9c49bfbdb4f1 tempest-ServerDiagnosticsNegativeTest-202360298 tempest-ServerDiagnosticsNegativeTest-202360298-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:39:32.134609 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-a18a3818-26d9-4ef8-b5de-9c49bfbdb4f1 tempest-ServerDiagnosticsNegativeTest-202360298 tempest-ServerDiagnosticsNegativeTest-202360298-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:39:32.805187 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.tasks.live_migrate [None req-178931de-f951-48fe-aa51-79c8e76faaf6 tempest-LiveMigrationTest-1685226576 tempest-LiveMigrationTest-1685226576-project-admin] [instance: 9762a487-917a-42f8-ab94-04780a8d678c] Start binding ports on destination host: n-h2-811414-3 {{(pid=94358) _bind_ports_on_destination /opt/stack/nova/nova/conductor/tasks/live_migrate.py:389}} Apr 21 10:39:48.256867 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-14097817-6c15-483d-9d65-998733df4324 tempest-ServersWithSpecificFlavorTestJSON-993972204 tempest-ServersWithSpecificFlavorTestJSON-993972204-project] Took 0.45 seconds to select destinations for 1 instance(s). {{(pid=94358) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 21 10:39:48.307219 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-14097817-6c15-483d-9d65-998733df4324 tempest-ServersWithSpecificFlavorTestJSON-993972204 tempest-ServersWithSpecificFlavorTestJSON-993972204-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:39:48.307631 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-14097817-6c15-483d-9d65-998733df4324 tempest-ServersWithSpecificFlavorTestJSON-993972204 tempest-ServersWithSpecificFlavorTestJSON-993972204-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:39:48.397992 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-14097817-6c15-483d-9d65-998733df4324 tempest-ServersWithSpecificFlavorTestJSON-993972204 tempest-ServersWithSpecificFlavorTestJSON-993972204-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:39:48.408935 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-14097817-6c15-483d-9d65-998733df4324 tempest-ServersWithSpecificFlavorTestJSON-993972204 tempest-ServersWithSpecificFlavorTestJSON-993972204-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:39:48.410051 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-14097817-6c15-483d-9d65-998733df4324 tempest-ServersWithSpecificFlavorTestJSON-993972204 tempest-ServersWithSpecificFlavorTestJSON-993972204-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:39:48.410595 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-14097817-6c15-483d-9d65-998733df4324 tempest-ServersWithSpecificFlavorTestJSON-993972204 tempest-ServersWithSpecificFlavorTestJSON-993972204-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:39:48.442514 n-d-811414-3 nova-conductor[94358]: DEBUG nova.quota [None req-14097817-6c15-483d-9d65-998733df4324 tempest-ServersWithSpecificFlavorTestJSON-993972204 tempest-ServersWithSpecificFlavorTestJSON-993972204-project] Getting quotas for project ac45715479a44120883bd084d7e36fe1. Resources: {'instances', 'cores', 'ram'} {{(pid=94358) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 21 10:39:48.447900 n-d-811414-3 nova-conductor[94358]: DEBUG nova.quota [None req-14097817-6c15-483d-9d65-998733df4324 tempest-ServersWithSpecificFlavorTestJSON-993972204 tempest-ServersWithSpecificFlavorTestJSON-993972204-project] Getting quotas for user e0a26102868d4f5b8af642cbf4125a18 and project ac45715479a44120883bd084d7e36fe1. Resources: {'instances', 'cores', 'ram'} {{(pid=94358) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 21 10:39:48.460279 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-14097817-6c15-483d-9d65-998733df4324 tempest-ServersWithSpecificFlavorTestJSON-993972204 tempest-ServersWithSpecificFlavorTestJSON-993972204-project] [instance: 3f05d248-627a-4213-bcee-e4637ff6c61f] Selected host: n-h2-811414-3; Selected node: n-h2-811414-3; Alternates: [('n-h1-811414-3', 'n-h1-811414-3')] {{(pid=94358) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 21 10:39:48.461826 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-14097817-6c15-483d-9d65-998733df4324 tempest-ServersWithSpecificFlavorTestJSON-993972204 tempest-ServersWithSpecificFlavorTestJSON-993972204-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:39:48.462372 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-14097817-6c15-483d-9d65-998733df4324 tempest-ServersWithSpecificFlavorTestJSON-993972204 tempest-ServersWithSpecificFlavorTestJSON-993972204-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:39:48.472512 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-14097817-6c15-483d-9d65-998733df4324 tempest-ServersWithSpecificFlavorTestJSON-993972204 tempest-ServersWithSpecificFlavorTestJSON-993972204-project] [instance: 3f05d248-627a-4213-bcee-e4637ff6c61f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f5cdc3d5-9524-4220-a7fc-ab5606975fdb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=-1,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=94358) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 21 10:39:48.474607 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-14097817-6c15-483d-9d65-998733df4324 tempest-ServersWithSpecificFlavorTestJSON-993972204 tempest-ServersWithSpecificFlavorTestJSON-993972204-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:39:48.475198 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-14097817-6c15-483d-9d65-998733df4324 tempest-ServersWithSpecificFlavorTestJSON-993972204 tempest-ServersWithSpecificFlavorTestJSON-993972204-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:39:48.484825 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-14097817-6c15-483d-9d65-998733df4324 tempest-ServersWithSpecificFlavorTestJSON-993972204 tempest-ServersWithSpecificFlavorTestJSON-993972204-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:39:48.485390 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-14097817-6c15-483d-9d65-998733df4324 tempest-ServersWithSpecificFlavorTestJSON-993972204 tempest-ServersWithSpecificFlavorTestJSON-993972204-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:39:48.528153 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-14097817-6c15-483d-9d65-998733df4324 tempest-ServersWithSpecificFlavorTestJSON-993972204 tempest-ServersWithSpecificFlavorTestJSON-993972204-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:39:48.528817 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-14097817-6c15-483d-9d65-998733df4324 tempest-ServersWithSpecificFlavorTestJSON-993972204 tempest-ServersWithSpecificFlavorTestJSON-993972204-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:39:57.021708 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-8fa16694-32be-4285-be99-f6ec37953c09 tempest-LiveMigrationTest-854730834 tempest-LiveMigrationTest-854730834-project] Took 0.50 seconds to select destinations for 1 instance(s). {{(pid=94357) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 21 10:39:57.066743 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-8fa16694-32be-4285-be99-f6ec37953c09 tempest-LiveMigrationTest-854730834 tempest-LiveMigrationTest-854730834-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:39:57.068457 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-8fa16694-32be-4285-be99-f6ec37953c09 tempest-LiveMigrationTest-854730834 tempest-LiveMigrationTest-854730834-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:39:57.169750 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-8fa16694-32be-4285-be99-f6ec37953c09 tempest-LiveMigrationTest-854730834 tempest-LiveMigrationTest-854730834-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:39:57.173155 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-8fa16694-32be-4285-be99-f6ec37953c09 tempest-LiveMigrationTest-854730834 tempest-LiveMigrationTest-854730834-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:39:57.179274 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-8fa16694-32be-4285-be99-f6ec37953c09 tempest-LiveMigrationTest-854730834 tempest-LiveMigrationTest-854730834-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:39:57.179931 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-8fa16694-32be-4285-be99-f6ec37953c09 tempest-LiveMigrationTest-854730834 tempest-LiveMigrationTest-854730834-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:39:57.230785 n-d-811414-3 nova-conductor[94357]: DEBUG nova.quota [None req-8fa16694-32be-4285-be99-f6ec37953c09 tempest-LiveMigrationTest-854730834 tempest-LiveMigrationTest-854730834-project] Getting quotas for project 827d444119b94ef6a099b8cf4c6a10ba. Resources: {'instances', 'cores', 'ram'} {{(pid=94357) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 21 10:39:57.249232 n-d-811414-3 nova-conductor[94357]: DEBUG nova.quota [None req-8fa16694-32be-4285-be99-f6ec37953c09 tempest-LiveMigrationTest-854730834 tempest-LiveMigrationTest-854730834-project] Getting quotas for user 8b0079bf33b34e3cb121c2ea48a694fc and project 827d444119b94ef6a099b8cf4c6a10ba. Resources: {'instances', 'cores', 'ram'} {{(pid=94357) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 21 10:39:57.291547 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-8fa16694-32be-4285-be99-f6ec37953c09 tempest-LiveMigrationTest-854730834 tempest-LiveMigrationTest-854730834-project] [instance: 6c646c73-163c-4e0c-98a7-393f5ed6391a] Selected host: n-h1-811414-3; Selected node: n-h1-811414-3; Alternates: [('n-h2-811414-3', 'n-h2-811414-3')] {{(pid=94357) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 21 10:39:57.297639 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-8fa16694-32be-4285-be99-f6ec37953c09 tempest-LiveMigrationTest-854730834 tempest-LiveMigrationTest-854730834-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:39:57.298084 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-8fa16694-32be-4285-be99-f6ec37953c09 tempest-LiveMigrationTest-854730834 tempest-LiveMigrationTest-854730834-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:39:57.310410 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-8fa16694-32be-4285-be99-f6ec37953c09 tempest-LiveMigrationTest-854730834 tempest-LiveMigrationTest-854730834-project] [instance: 6c646c73-163c-4e0c-98a7-393f5ed6391a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f5cdc3d5-9524-4220-a7fc-ab5606975fdb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94357) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 21 10:39:57.312259 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-8fa16694-32be-4285-be99-f6ec37953c09 tempest-LiveMigrationTest-854730834 tempest-LiveMigrationTest-854730834-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:39:57.314315 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-8fa16694-32be-4285-be99-f6ec37953c09 tempest-LiveMigrationTest-854730834 tempest-LiveMigrationTest-854730834-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:39:57.366766 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-8fa16694-32be-4285-be99-f6ec37953c09 tempest-LiveMigrationTest-854730834 tempest-LiveMigrationTest-854730834-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:39:57.368249 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-8fa16694-32be-4285-be99-f6ec37953c09 tempest-LiveMigrationTest-854730834 tempest-LiveMigrationTest-854730834-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:40:00.596547 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-11e02f9c-4e44-4cc0-a482-7829f1dc6501 tempest-ServersAdminTestJSON-344211291 tempest-ServersAdminTestJSON-344211291-project] Took 0.45 seconds to select destinations for 1 instance(s). {{(pid=94358) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 21 10:40:00.645834 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-11e02f9c-4e44-4cc0-a482-7829f1dc6501 tempest-ServersAdminTestJSON-344211291 tempest-ServersAdminTestJSON-344211291-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:40:00.646242 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-11e02f9c-4e44-4cc0-a482-7829f1dc6501 tempest-ServersAdminTestJSON-344211291 tempest-ServersAdminTestJSON-344211291-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:40:00.755879 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-11e02f9c-4e44-4cc0-a482-7829f1dc6501 tempest-ServersAdminTestJSON-344211291 tempest-ServersAdminTestJSON-344211291-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:40:00.757538 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-11e02f9c-4e44-4cc0-a482-7829f1dc6501 tempest-ServersAdminTestJSON-344211291 tempest-ServersAdminTestJSON-344211291-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:40:00.758289 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-11e02f9c-4e44-4cc0-a482-7829f1dc6501 tempest-ServersAdminTestJSON-344211291 tempest-ServersAdminTestJSON-344211291-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:40:00.758686 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-11e02f9c-4e44-4cc0-a482-7829f1dc6501 tempest-ServersAdminTestJSON-344211291 tempest-ServersAdminTestJSON-344211291-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:40:00.802193 n-d-811414-3 nova-conductor[94358]: DEBUG nova.quota [None req-11e02f9c-4e44-4cc0-a482-7829f1dc6501 tempest-ServersAdminTestJSON-344211291 tempest-ServersAdminTestJSON-344211291-project] Getting quotas for project ef4e03cedfa24337a14b428696d78047. Resources: {'instances', 'cores', 'ram'} {{(pid=94358) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 21 10:40:00.819195 n-d-811414-3 nova-conductor[94358]: DEBUG nova.quota [None req-11e02f9c-4e44-4cc0-a482-7829f1dc6501 tempest-ServersAdminTestJSON-344211291 tempest-ServersAdminTestJSON-344211291-project] Getting quotas for user b000034dc6504c5088ae98b4709f4fc1 and project ef4e03cedfa24337a14b428696d78047. Resources: {'instances', 'cores', 'ram'} {{(pid=94358) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 21 10:40:00.857197 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-11e02f9c-4e44-4cc0-a482-7829f1dc6501 tempest-ServersAdminTestJSON-344211291 tempest-ServersAdminTestJSON-344211291-project] [instance: 1d3b2b74-673e-461b-b458-2c0d82f2fd73] Selected host: n-h1-811414-3; Selected node: n-h1-811414-3; Alternates: [('n-h2-811414-3', 'n-h2-811414-3')] {{(pid=94358) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 21 10:40:00.861274 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-11e02f9c-4e44-4cc0-a482-7829f1dc6501 tempest-ServersAdminTestJSON-344211291 tempest-ServersAdminTestJSON-344211291-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:40:00.863030 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-11e02f9c-4e44-4cc0-a482-7829f1dc6501 tempest-ServersAdminTestJSON-344211291 tempest-ServersAdminTestJSON-344211291-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:40:00.882928 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-11e02f9c-4e44-4cc0-a482-7829f1dc6501 tempest-ServersAdminTestJSON-344211291 tempest-ServersAdminTestJSON-344211291-project] [instance: 1d3b2b74-673e-461b-b458-2c0d82f2fd73] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f5cdc3d5-9524-4220-a7fc-ab5606975fdb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94358) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 21 10:40:00.885014 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-11e02f9c-4e44-4cc0-a482-7829f1dc6501 tempest-ServersAdminTestJSON-344211291 tempest-ServersAdminTestJSON-344211291-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:40:00.885573 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-11e02f9c-4e44-4cc0-a482-7829f1dc6501 tempest-ServersAdminTestJSON-344211291 tempest-ServersAdminTestJSON-344211291-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:40:00.937789 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-11e02f9c-4e44-4cc0-a482-7829f1dc6501 tempest-ServersAdminTestJSON-344211291 tempest-ServersAdminTestJSON-344211291-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:40:00.938637 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-11e02f9c-4e44-4cc0-a482-7829f1dc6501 tempest-ServersAdminTestJSON-344211291 tempest-ServersAdminTestJSON-344211291-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:40:02.393086 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-1851d877-f3c4-4e15-8401-cd4f8b72c104 tempest-ServersAdminTestJSON-344211291 tempest-ServersAdminTestJSON-344211291-project] Took 0.41 seconds to select destinations for 1 instance(s). {{(pid=94357) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 21 10:40:02.444997 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-1851d877-f3c4-4e15-8401-cd4f8b72c104 tempest-ServersAdminTestJSON-344211291 tempest-ServersAdminTestJSON-344211291-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:40:02.446082 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-1851d877-f3c4-4e15-8401-cd4f8b72c104 tempest-ServersAdminTestJSON-344211291 tempest-ServersAdminTestJSON-344211291-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:40:02.546552 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-1851d877-f3c4-4e15-8401-cd4f8b72c104 tempest-ServersAdminTestJSON-344211291 tempest-ServersAdminTestJSON-344211291-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:40:02.546961 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-1851d877-f3c4-4e15-8401-cd4f8b72c104 tempest-ServersAdminTestJSON-344211291 tempest-ServersAdminTestJSON-344211291-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:40:02.547688 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-1851d877-f3c4-4e15-8401-cd4f8b72c104 tempest-ServersAdminTestJSON-344211291 tempest-ServersAdminTestJSON-344211291-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:40:02.548249 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-1851d877-f3c4-4e15-8401-cd4f8b72c104 tempest-ServersAdminTestJSON-344211291 tempest-ServersAdminTestJSON-344211291-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:40:02.567616 n-d-811414-3 nova-conductor[94357]: DEBUG nova.quota [None req-1851d877-f3c4-4e15-8401-cd4f8b72c104 tempest-ServersAdminTestJSON-344211291 tempest-ServersAdminTestJSON-344211291-project] Getting quotas for project ef4e03cedfa24337a14b428696d78047. Resources: {'instances', 'cores', 'ram'} {{(pid=94357) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 21 10:40:02.574006 n-d-811414-3 nova-conductor[94357]: DEBUG nova.quota [None req-1851d877-f3c4-4e15-8401-cd4f8b72c104 tempest-ServersAdminTestJSON-344211291 tempest-ServersAdminTestJSON-344211291-project] Getting quotas for user b000034dc6504c5088ae98b4709f4fc1 and project ef4e03cedfa24337a14b428696d78047. Resources: {'instances', 'cores', 'ram'} {{(pid=94357) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 21 10:40:02.610542 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-1851d877-f3c4-4e15-8401-cd4f8b72c104 tempest-ServersAdminTestJSON-344211291 tempest-ServersAdminTestJSON-344211291-project] [instance: 61f1acf4-1e28-48e9-899e-14204cc3e45a] Selected host: n-h2-811414-3; Selected node: n-h2-811414-3; Alternates: [('n-h1-811414-3', 'n-h1-811414-3')] {{(pid=94357) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 21 10:40:02.614421 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-1851d877-f3c4-4e15-8401-cd4f8b72c104 tempest-ServersAdminTestJSON-344211291 tempest-ServersAdminTestJSON-344211291-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:40:02.614994 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-1851d877-f3c4-4e15-8401-cd4f8b72c104 tempest-ServersAdminTestJSON-344211291 tempest-ServersAdminTestJSON-344211291-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:40:02.628816 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-1851d877-f3c4-4e15-8401-cd4f8b72c104 tempest-ServersAdminTestJSON-344211291 tempest-ServersAdminTestJSON-344211291-project] [instance: 61f1acf4-1e28-48e9-899e-14204cc3e45a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f5cdc3d5-9524-4220-a7fc-ab5606975fdb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94357) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 21 10:40:02.632477 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-1851d877-f3c4-4e15-8401-cd4f8b72c104 tempest-ServersAdminTestJSON-344211291 tempest-ServersAdminTestJSON-344211291-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:40:02.632886 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-1851d877-f3c4-4e15-8401-cd4f8b72c104 tempest-ServersAdminTestJSON-344211291 tempest-ServersAdminTestJSON-344211291-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:40:02.691601 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-1851d877-f3c4-4e15-8401-cd4f8b72c104 tempest-ServersAdminTestJSON-344211291 tempest-ServersAdminTestJSON-344211291-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:40:02.692109 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-1851d877-f3c4-4e15-8401-cd4f8b72c104 tempest-ServersAdminTestJSON-344211291 tempest-ServersAdminTestJSON-344211291-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:40:06.357502 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-b030c3d9-3d9b-4bf9-a4a6-e67c93fb849c tempest-ServersAdminNegativeTestJSON-1103264428 tempest-ServersAdminNegativeTestJSON-1103264428-project] Took 0.61 seconds to select destinations for 1 instance(s). {{(pid=94358) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 21 10:40:06.431817 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-b030c3d9-3d9b-4bf9-a4a6-e67c93fb849c tempest-ServersAdminNegativeTestJSON-1103264428 tempest-ServersAdminNegativeTestJSON-1103264428-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:40:06.432560 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-b030c3d9-3d9b-4bf9-a4a6-e67c93fb849c tempest-ServersAdminNegativeTestJSON-1103264428 tempest-ServersAdminNegativeTestJSON-1103264428-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:40:06.551853 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-b030c3d9-3d9b-4bf9-a4a6-e67c93fb849c tempest-ServersAdminNegativeTestJSON-1103264428 tempest-ServersAdminNegativeTestJSON-1103264428-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:40:06.552257 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-b030c3d9-3d9b-4bf9-a4a6-e67c93fb849c tempest-ServersAdminNegativeTestJSON-1103264428 tempest-ServersAdminNegativeTestJSON-1103264428-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:40:06.553106 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-b030c3d9-3d9b-4bf9-a4a6-e67c93fb849c tempest-ServersAdminNegativeTestJSON-1103264428 tempest-ServersAdminNegativeTestJSON-1103264428-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:40:06.553741 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-b030c3d9-3d9b-4bf9-a4a6-e67c93fb849c tempest-ServersAdminNegativeTestJSON-1103264428 tempest-ServersAdminNegativeTestJSON-1103264428-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:40:06.575399 n-d-811414-3 nova-conductor[94358]: DEBUG nova.quota [None req-b030c3d9-3d9b-4bf9-a4a6-e67c93fb849c tempest-ServersAdminNegativeTestJSON-1103264428 tempest-ServersAdminNegativeTestJSON-1103264428-project] Getting quotas for project 55925eecd3724a94bfb4d494919e6c24. Resources: {'instances', 'cores', 'ram'} {{(pid=94358) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 21 10:40:06.582534 n-d-811414-3 nova-conductor[94358]: DEBUG nova.quota [None req-b030c3d9-3d9b-4bf9-a4a6-e67c93fb849c tempest-ServersAdminNegativeTestJSON-1103264428 tempest-ServersAdminNegativeTestJSON-1103264428-project] Getting quotas for user 4242975c26674c808e94773e18a81be8 and project 55925eecd3724a94bfb4d494919e6c24. Resources: {'instances', 'cores', 'ram'} {{(pid=94358) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 21 10:40:06.597511 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-b030c3d9-3d9b-4bf9-a4a6-e67c93fb849c tempest-ServersAdminNegativeTestJSON-1103264428 tempest-ServersAdminNegativeTestJSON-1103264428-project] [instance: edf56f74-ca81-45e9-8d8f-148626ff4e2a] Selected host: n-h1-811414-3; Selected node: n-h1-811414-3; Alternates: [('n-h2-811414-3', 'n-h2-811414-3')] {{(pid=94358) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 21 10:40:06.599749 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-b030c3d9-3d9b-4bf9-a4a6-e67c93fb849c tempest-ServersAdminNegativeTestJSON-1103264428 tempest-ServersAdminNegativeTestJSON-1103264428-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:40:06.600312 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-b030c3d9-3d9b-4bf9-a4a6-e67c93fb849c tempest-ServersAdminNegativeTestJSON-1103264428 tempest-ServersAdminNegativeTestJSON-1103264428-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:40:06.610058 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-b030c3d9-3d9b-4bf9-a4a6-e67c93fb849c tempest-ServersAdminNegativeTestJSON-1103264428 tempest-ServersAdminNegativeTestJSON-1103264428-project] [instance: edf56f74-ca81-45e9-8d8f-148626ff4e2a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f5cdc3d5-9524-4220-a7fc-ab5606975fdb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94358) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 21 10:40:06.611767 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-b030c3d9-3d9b-4bf9-a4a6-e67c93fb849c tempest-ServersAdminNegativeTestJSON-1103264428 tempest-ServersAdminNegativeTestJSON-1103264428-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:40:06.612354 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-b030c3d9-3d9b-4bf9-a4a6-e67c93fb849c tempest-ServersAdminNegativeTestJSON-1103264428 tempest-ServersAdminNegativeTestJSON-1103264428-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:40:06.660096 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-b030c3d9-3d9b-4bf9-a4a6-e67c93fb849c tempest-ServersAdminNegativeTestJSON-1103264428 tempest-ServersAdminNegativeTestJSON-1103264428-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:40:06.660771 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-b030c3d9-3d9b-4bf9-a4a6-e67c93fb849c tempest-ServersAdminNegativeTestJSON-1103264428 tempest-ServersAdminNegativeTestJSON-1103264428-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:40:16.796583 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-4bd240fc-ec3e-492f-b529-e17381e98728 tempest-LiveAutoBlockMigrationV225Test-499396072 tempest-LiveAutoBlockMigrationV225Test-499396072-project] Took 0.42 seconds to select destinations for 1 instance(s). {{(pid=94357) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 21 10:40:16.842242 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-4bd240fc-ec3e-492f-b529-e17381e98728 tempest-LiveAutoBlockMigrationV225Test-499396072 tempest-LiveAutoBlockMigrationV225Test-499396072-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:40:16.843331 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-4bd240fc-ec3e-492f-b529-e17381e98728 tempest-LiveAutoBlockMigrationV225Test-499396072 tempest-LiveAutoBlockMigrationV225Test-499396072-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:40:16.915535 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-4bd240fc-ec3e-492f-b529-e17381e98728 tempest-LiveAutoBlockMigrationV225Test-499396072 tempest-LiveAutoBlockMigrationV225Test-499396072-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:40:16.916505 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-4bd240fc-ec3e-492f-b529-e17381e98728 tempest-LiveAutoBlockMigrationV225Test-499396072 tempest-LiveAutoBlockMigrationV225Test-499396072-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:40:16.917722 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-4bd240fc-ec3e-492f-b529-e17381e98728 tempest-LiveAutoBlockMigrationV225Test-499396072 tempest-LiveAutoBlockMigrationV225Test-499396072-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:40:16.918814 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-4bd240fc-ec3e-492f-b529-e17381e98728 tempest-LiveAutoBlockMigrationV225Test-499396072 tempest-LiveAutoBlockMigrationV225Test-499396072-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:40:16.958582 n-d-811414-3 nova-conductor[94357]: DEBUG nova.quota [None req-4bd240fc-ec3e-492f-b529-e17381e98728 tempest-LiveAutoBlockMigrationV225Test-499396072 tempest-LiveAutoBlockMigrationV225Test-499396072-project] Getting quotas for project a5d2c091696a4f63867bc69db107ba91. Resources: {'instances', 'cores', 'ram'} {{(pid=94357) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 21 10:40:16.976342 n-d-811414-3 nova-conductor[94357]: DEBUG nova.quota [None req-4bd240fc-ec3e-492f-b529-e17381e98728 tempest-LiveAutoBlockMigrationV225Test-499396072 tempest-LiveAutoBlockMigrationV225Test-499396072-project] Getting quotas for user 5b64c5ff88744287b5a5cf822fbbf185 and project a5d2c091696a4f63867bc69db107ba91. Resources: {'instances', 'cores', 'ram'} {{(pid=94357) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 21 10:40:17.000659 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-4bd240fc-ec3e-492f-b529-e17381e98728 tempest-LiveAutoBlockMigrationV225Test-499396072 tempest-LiveAutoBlockMigrationV225Test-499396072-project] [instance: 0467c92f-b8ca-4ab6-960c-b25b1b4bf7cd] Selected host: n-h2-811414-3; Selected node: n-h2-811414-3; Alternates: [('n-h1-811414-3', 'n-h1-811414-3')] {{(pid=94357) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 21 10:40:17.002522 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-4bd240fc-ec3e-492f-b529-e17381e98728 tempest-LiveAutoBlockMigrationV225Test-499396072 tempest-LiveAutoBlockMigrationV225Test-499396072-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:40:17.003303 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-4bd240fc-ec3e-492f-b529-e17381e98728 tempest-LiveAutoBlockMigrationV225Test-499396072 tempest-LiveAutoBlockMigrationV225Test-499396072-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:40:17.011884 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-4bd240fc-ec3e-492f-b529-e17381e98728 tempest-LiveAutoBlockMigrationV225Test-499396072 tempest-LiveAutoBlockMigrationV225Test-499396072-project] [instance: 0467c92f-b8ca-4ab6-960c-b25b1b4bf7cd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f5cdc3d5-9524-4220-a7fc-ab5606975fdb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94357) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 21 10:40:17.016801 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-4bd240fc-ec3e-492f-b529-e17381e98728 tempest-LiveAutoBlockMigrationV225Test-499396072 tempest-LiveAutoBlockMigrationV225Test-499396072-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:40:17.017442 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-4bd240fc-ec3e-492f-b529-e17381e98728 tempest-LiveAutoBlockMigrationV225Test-499396072 tempest-LiveAutoBlockMigrationV225Test-499396072-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:40:17.080159 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-4bd240fc-ec3e-492f-b529-e17381e98728 tempest-LiveAutoBlockMigrationV225Test-499396072 tempest-LiveAutoBlockMigrationV225Test-499396072-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:40:17.080640 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-4bd240fc-ec3e-492f-b529-e17381e98728 tempest-LiveAutoBlockMigrationV225Test-499396072 tempest-LiveAutoBlockMigrationV225Test-499396072-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:40:20.633885 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-666b1d01-092f-44cc-9b1f-3dc1765f37fb tempest-TenantUsagesTestJSON-1540044589 tempest-TenantUsagesTestJSON-1540044589-project] Took 0.28 seconds to select destinations for 1 instance(s). {{(pid=94358) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 21 10:40:20.658017 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-666b1d01-092f-44cc-9b1f-3dc1765f37fb tempest-TenantUsagesTestJSON-1540044589 tempest-TenantUsagesTestJSON-1540044589-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:40:20.658222 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-666b1d01-092f-44cc-9b1f-3dc1765f37fb tempest-TenantUsagesTestJSON-1540044589 tempest-TenantUsagesTestJSON-1540044589-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:40:20.713036 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-666b1d01-092f-44cc-9b1f-3dc1765f37fb tempest-TenantUsagesTestJSON-1540044589 tempest-TenantUsagesTestJSON-1540044589-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:40:20.713532 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-666b1d01-092f-44cc-9b1f-3dc1765f37fb tempest-TenantUsagesTestJSON-1540044589 tempest-TenantUsagesTestJSON-1540044589-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:40:20.714315 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-666b1d01-092f-44cc-9b1f-3dc1765f37fb tempest-TenantUsagesTestJSON-1540044589 tempest-TenantUsagesTestJSON-1540044589-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:40:20.714773 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-666b1d01-092f-44cc-9b1f-3dc1765f37fb tempest-TenantUsagesTestJSON-1540044589 tempest-TenantUsagesTestJSON-1540044589-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:40:20.732239 n-d-811414-3 nova-conductor[94358]: DEBUG nova.quota [None req-666b1d01-092f-44cc-9b1f-3dc1765f37fb tempest-TenantUsagesTestJSON-1540044589 tempest-TenantUsagesTestJSON-1540044589-project] Getting quotas for project fedb2ed4ac934c9680115176e272f4f1. Resources: {'instances', 'cores', 'ram'} {{(pid=94358) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 21 10:40:20.738870 n-d-811414-3 nova-conductor[94358]: DEBUG nova.quota [None req-666b1d01-092f-44cc-9b1f-3dc1765f37fb tempest-TenantUsagesTestJSON-1540044589 tempest-TenantUsagesTestJSON-1540044589-project] Getting quotas for user 19ac6b3b603440bdbbc2928e0887f22b and project fedb2ed4ac934c9680115176e272f4f1. Resources: {'instances', 'cores', 'ram'} {{(pid=94358) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 21 10:40:20.750397 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-666b1d01-092f-44cc-9b1f-3dc1765f37fb tempest-TenantUsagesTestJSON-1540044589 tempest-TenantUsagesTestJSON-1540044589-project] [instance: 0a122704-2391-4ed2-b471-c8ac84ac26f5] Selected host: n-h1-811414-3; Selected node: n-h1-811414-3; Alternates: [('n-h2-811414-3', 'n-h2-811414-3')] {{(pid=94358) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 21 10:40:20.751420 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-666b1d01-092f-44cc-9b1f-3dc1765f37fb tempest-TenantUsagesTestJSON-1540044589 tempest-TenantUsagesTestJSON-1540044589-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:40:20.751891 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-666b1d01-092f-44cc-9b1f-3dc1765f37fb tempest-TenantUsagesTestJSON-1540044589 tempest-TenantUsagesTestJSON-1540044589-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:40:20.758674 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-666b1d01-092f-44cc-9b1f-3dc1765f37fb tempest-TenantUsagesTestJSON-1540044589 tempest-TenantUsagesTestJSON-1540044589-project] [instance: 0a122704-2391-4ed2-b471-c8ac84ac26f5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f5cdc3d5-9524-4220-a7fc-ab5606975fdb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94358) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 21 10:40:20.760113 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-666b1d01-092f-44cc-9b1f-3dc1765f37fb tempest-TenantUsagesTestJSON-1540044589 tempest-TenantUsagesTestJSON-1540044589-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:40:20.760706 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-666b1d01-092f-44cc-9b1f-3dc1765f37fb tempest-TenantUsagesTestJSON-1540044589 tempest-TenantUsagesTestJSON-1540044589-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:40:20.793653 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-666b1d01-092f-44cc-9b1f-3dc1765f37fb tempest-TenantUsagesTestJSON-1540044589 tempest-TenantUsagesTestJSON-1540044589-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:40:20.794419 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-666b1d01-092f-44cc-9b1f-3dc1765f37fb tempest-TenantUsagesTestJSON-1540044589 tempest-TenantUsagesTestJSON-1540044589-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:40:26.531032 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-9b048591-dbee-4e5c-94bc-5ba549467833 tempest-LiveMigrationTest-1685226576 tempest-LiveMigrationTest-1685226576-project-admin] Targeting cell 6c99d8ec-fb48-48af-b02b-a629a7c2cb6b(cell1) for conductor method migrate_server {{(pid=94357) wrapper /opt/stack/nova/nova/conductor/manager.py:91}} Apr 21 10:40:26.532097 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-9b048591-dbee-4e5c-94bc-5ba549467833 tempest-LiveMigrationTest-1685226576 tempest-LiveMigrationTest-1685226576-project-admin] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:40:26.532715 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-9b048591-dbee-4e5c-94bc-5ba549467833 tempest-LiveMigrationTest-1685226576 tempest-LiveMigrationTest-1685226576-project-admin] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:40:27.021628 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.tasks.migrate [None req-9b048591-dbee-4e5c-94bc-5ba549467833 tempest-LiveMigrationTest-1685226576 tempest-LiveMigrationTest-1685226576-project-admin] Created allocations for migration 9cecbc19-6503-4948-ab2d-8e146192f980 on 43480f3a-fb09-463e-8326-6927c98a38b4 {{(pid=94357) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} Apr 21 10:40:27.159885 n-d-811414-3 nova-conductor[94357]: DEBUG nova.scheduler.utils [None req-9b048591-dbee-4e5c-94bc-5ba549467833 tempest-LiveMigrationTest-1685226576 tempest-LiveMigrationTest-1685226576-project-admin] [instance: 6c646c73-163c-4e0c-98a7-393f5ed6391a] Instance allocations successfully created on destination node 6ea3f8b1-0c53-40ba-ba27-f80f78a284a6: {'allocations': {'6ea3f8b1-0c53-40ba-ba27-f80f78a284a6': {'resources': {'VCPU': 1, 'MEMORY_MB': 1024, 'DISK_GB': 1}}}} {{(pid=94357) claim_resources_on_destination /opt/stack/nova/nova/scheduler/utils.py:827}} Apr 21 10:40:27.160468 n-d-811414-3 nova-conductor[94357]: DEBUG nova.objects.instance [None req-9b048591-dbee-4e5c-94bc-5ba549467833 tempest-LiveMigrationTest-1685226576 tempest-LiveMigrationTest-1685226576-project-admin] Lazy-loading 'resources' on Instance uuid 6c646c73-163c-4e0c-98a7-393f5ed6391a {{(pid=94357) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Apr 21 10:40:27.166685 n-d-811414-3 nova-conductor[94357]: DEBUG nova.objects.instance [None req-9b048591-dbee-4e5c-94bc-5ba549467833 tempest-LiveMigrationTest-1685226576 tempest-LiveMigrationTest-1685226576-project-admin] Lazy-loading 'pci_requests' on Instance uuid 6c646c73-163c-4e0c-98a7-393f5ed6391a {{(pid=94357) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Apr 21 10:40:27.770035 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.tasks.live_migrate [None req-9b048591-dbee-4e5c-94bc-5ba549467833 tempest-LiveMigrationTest-1685226576 tempest-LiveMigrationTest-1685226576-project-admin] [instance: 6c646c73-163c-4e0c-98a7-393f5ed6391a] Start binding ports on destination host: n-h2-811414-3 {{(pid=94357) _bind_ports_on_destination /opt/stack/nova/nova/conductor/tasks/live_migrate.py:389}} Apr 21 10:40:28.103166 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-a6df0e9f-d0fa-4151-82fe-57151a74d51f tempest-FloatingIPsAssociationNegativeTestJSON-207418399 tempest-FloatingIPsAssociationNegativeTestJSON-207418399-project] Took 1.43 seconds to select destinations for 1 instance(s). {{(pid=94358) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 21 10:40:28.146670 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-a6df0e9f-d0fa-4151-82fe-57151a74d51f tempest-FloatingIPsAssociationNegativeTestJSON-207418399 tempest-FloatingIPsAssociationNegativeTestJSON-207418399-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:40:28.147236 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-a6df0e9f-d0fa-4151-82fe-57151a74d51f tempest-FloatingIPsAssociationNegativeTestJSON-207418399 tempest-FloatingIPsAssociationNegativeTestJSON-207418399-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:40:28.243366 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-a6df0e9f-d0fa-4151-82fe-57151a74d51f tempest-FloatingIPsAssociationNegativeTestJSON-207418399 tempest-FloatingIPsAssociationNegativeTestJSON-207418399-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:40:28.244140 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-a6df0e9f-d0fa-4151-82fe-57151a74d51f tempest-FloatingIPsAssociationNegativeTestJSON-207418399 tempest-FloatingIPsAssociationNegativeTestJSON-207418399-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:40:28.245122 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-a6df0e9f-d0fa-4151-82fe-57151a74d51f tempest-FloatingIPsAssociationNegativeTestJSON-207418399 tempest-FloatingIPsAssociationNegativeTestJSON-207418399-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:40:28.245720 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-a6df0e9f-d0fa-4151-82fe-57151a74d51f tempest-FloatingIPsAssociationNegativeTestJSON-207418399 tempest-FloatingIPsAssociationNegativeTestJSON-207418399-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:40:28.267458 n-d-811414-3 nova-conductor[94358]: DEBUG nova.quota [None req-a6df0e9f-d0fa-4151-82fe-57151a74d51f tempest-FloatingIPsAssociationNegativeTestJSON-207418399 tempest-FloatingIPsAssociationNegativeTestJSON-207418399-project] Getting quotas for project cb218eb0aeb24eb48122220122de81de. Resources: {'instances', 'cores', 'ram'} {{(pid=94358) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 21 10:40:28.277969 n-d-811414-3 nova-conductor[94358]: DEBUG nova.quota [None req-a6df0e9f-d0fa-4151-82fe-57151a74d51f tempest-FloatingIPsAssociationNegativeTestJSON-207418399 tempest-FloatingIPsAssociationNegativeTestJSON-207418399-project] Getting quotas for user da6d24c15e734361ac877dc9e69529cd and project cb218eb0aeb24eb48122220122de81de. Resources: {'instances', 'cores', 'ram'} {{(pid=94358) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 21 10:40:28.293531 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-a6df0e9f-d0fa-4151-82fe-57151a74d51f tempest-FloatingIPsAssociationNegativeTestJSON-207418399 tempest-FloatingIPsAssociationNegativeTestJSON-207418399-project] [instance: adef99ae-e584-4673-96d5-60b1df135ab5] Selected host: n-h2-811414-3; Selected node: n-h2-811414-3; Alternates: [('n-h1-811414-3', 'n-h1-811414-3')] {{(pid=94358) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 21 10:40:28.294845 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-a6df0e9f-d0fa-4151-82fe-57151a74d51f tempest-FloatingIPsAssociationNegativeTestJSON-207418399 tempest-FloatingIPsAssociationNegativeTestJSON-207418399-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:40:28.296150 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-a6df0e9f-d0fa-4151-82fe-57151a74d51f tempest-FloatingIPsAssociationNegativeTestJSON-207418399 tempest-FloatingIPsAssociationNegativeTestJSON-207418399-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:40:28.315959 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-a6df0e9f-d0fa-4151-82fe-57151a74d51f tempest-FloatingIPsAssociationNegativeTestJSON-207418399 tempest-FloatingIPsAssociationNegativeTestJSON-207418399-project] [instance: adef99ae-e584-4673-96d5-60b1df135ab5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f5cdc3d5-9524-4220-a7fc-ab5606975fdb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94358) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 21 10:40:28.317302 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-a6df0e9f-d0fa-4151-82fe-57151a74d51f tempest-FloatingIPsAssociationNegativeTestJSON-207418399 tempest-FloatingIPsAssociationNegativeTestJSON-207418399-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:40:28.318530 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-a6df0e9f-d0fa-4151-82fe-57151a74d51f tempest-FloatingIPsAssociationNegativeTestJSON-207418399 tempest-FloatingIPsAssociationNegativeTestJSON-207418399-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:40:28.371205 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-a6df0e9f-d0fa-4151-82fe-57151a74d51f tempest-FloatingIPsAssociationNegativeTestJSON-207418399 tempest-FloatingIPsAssociationNegativeTestJSON-207418399-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:40:28.371683 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-a6df0e9f-d0fa-4151-82fe-57151a74d51f tempest-FloatingIPsAssociationNegativeTestJSON-207418399 tempest-FloatingIPsAssociationNegativeTestJSON-207418399-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:40:29.839387 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-04055709-0a9e-4468-a127-084beecffc18 tempest-VolumesAdminNegativeTest-683947140 tempest-VolumesAdminNegativeTest-683947140-project] Took 0.33 seconds to select destinations for 1 instance(s). {{(pid=94357) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 21 10:40:29.866230 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-04055709-0a9e-4468-a127-084beecffc18 tempest-VolumesAdminNegativeTest-683947140 tempest-VolumesAdminNegativeTest-683947140-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:40:29.866787 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-04055709-0a9e-4468-a127-084beecffc18 tempest-VolumesAdminNegativeTest-683947140 tempest-VolumesAdminNegativeTest-683947140-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:40:29.926490 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-04055709-0a9e-4468-a127-084beecffc18 tempest-VolumesAdminNegativeTest-683947140 tempest-VolumesAdminNegativeTest-683947140-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:40:29.927099 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-04055709-0a9e-4468-a127-084beecffc18 tempest-VolumesAdminNegativeTest-683947140 tempest-VolumesAdminNegativeTest-683947140-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:40:29.928116 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-04055709-0a9e-4468-a127-084beecffc18 tempest-VolumesAdminNegativeTest-683947140 tempest-VolumesAdminNegativeTest-683947140-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:40:29.928688 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-04055709-0a9e-4468-a127-084beecffc18 tempest-VolumesAdminNegativeTest-683947140 tempest-VolumesAdminNegativeTest-683947140-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:40:29.948943 n-d-811414-3 nova-conductor[94357]: DEBUG nova.quota [None req-04055709-0a9e-4468-a127-084beecffc18 tempest-VolumesAdminNegativeTest-683947140 tempest-VolumesAdminNegativeTest-683947140-project] Getting quotas for project bb5939349d764946878d8ed01e5640c7. Resources: {'instances', 'cores', 'ram'} {{(pid=94357) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 21 10:40:29.954845 n-d-811414-3 nova-conductor[94357]: DEBUG nova.quota [None req-04055709-0a9e-4468-a127-084beecffc18 tempest-VolumesAdminNegativeTest-683947140 tempest-VolumesAdminNegativeTest-683947140-project] Getting quotas for user 3beacd29371840c79850e9b80665397e and project bb5939349d764946878d8ed01e5640c7. Resources: {'instances', 'cores', 'ram'} {{(pid=94357) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 21 10:40:29.966359 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-04055709-0a9e-4468-a127-084beecffc18 tempest-VolumesAdminNegativeTest-683947140 tempest-VolumesAdminNegativeTest-683947140-project] [instance: a77fd93d-3462-4536-a87e-40615107857e] Selected host: n-h1-811414-3; Selected node: n-h1-811414-3; Alternates: [('n-h2-811414-3', 'n-h2-811414-3')] {{(pid=94357) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 21 10:40:29.967569 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-04055709-0a9e-4468-a127-084beecffc18 tempest-VolumesAdminNegativeTest-683947140 tempest-VolumesAdminNegativeTest-683947140-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:40:29.968142 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-04055709-0a9e-4468-a127-084beecffc18 tempest-VolumesAdminNegativeTest-683947140 tempest-VolumesAdminNegativeTest-683947140-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:40:29.976016 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-04055709-0a9e-4468-a127-084beecffc18 tempest-VolumesAdminNegativeTest-683947140 tempest-VolumesAdminNegativeTest-683947140-project] [instance: a77fd93d-3462-4536-a87e-40615107857e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f5cdc3d5-9524-4220-a7fc-ab5606975fdb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94357) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 21 10:40:29.977655 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-04055709-0a9e-4468-a127-084beecffc18 tempest-VolumesAdminNegativeTest-683947140 tempest-VolumesAdminNegativeTest-683947140-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:40:29.978155 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-04055709-0a9e-4468-a127-084beecffc18 tempest-VolumesAdminNegativeTest-683947140 tempest-VolumesAdminNegativeTest-683947140-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:40:30.012557 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-04055709-0a9e-4468-a127-084beecffc18 tempest-VolumesAdminNegativeTest-683947140 tempest-VolumesAdminNegativeTest-683947140-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:40:30.013169 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-04055709-0a9e-4468-a127-084beecffc18 tempest-VolumesAdminNegativeTest-683947140 tempest-VolumesAdminNegativeTest-683947140-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:40:32.410972 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-0b03cf24-47f5-49ef-a20b-f1989115c95f tempest-ServersAdminTestJSON-344211291 tempest-ServersAdminTestJSON-344211291-project] Took 0.39 seconds to select destinations for 1 instance(s). {{(pid=94358) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 21 10:40:32.439904 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-0b03cf24-47f5-49ef-a20b-f1989115c95f tempest-ServersAdminTestJSON-344211291 tempest-ServersAdminTestJSON-344211291-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:40:32.439904 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-0b03cf24-47f5-49ef-a20b-f1989115c95f tempest-ServersAdminTestJSON-344211291 tempest-ServersAdminTestJSON-344211291-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:40:32.500565 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-0b03cf24-47f5-49ef-a20b-f1989115c95f tempest-ServersAdminTestJSON-344211291 tempest-ServersAdminTestJSON-344211291-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:40:32.501176 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-0b03cf24-47f5-49ef-a20b-f1989115c95f tempest-ServersAdminTestJSON-344211291 tempest-ServersAdminTestJSON-344211291-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:40:32.502024 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-0b03cf24-47f5-49ef-a20b-f1989115c95f tempest-ServersAdminTestJSON-344211291 tempest-ServersAdminTestJSON-344211291-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:40:32.502494 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-0b03cf24-47f5-49ef-a20b-f1989115c95f tempest-ServersAdminTestJSON-344211291 tempest-ServersAdminTestJSON-344211291-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:40:32.524959 n-d-811414-3 nova-conductor[94358]: DEBUG nova.quota [None req-0b03cf24-47f5-49ef-a20b-f1989115c95f tempest-ServersAdminTestJSON-344211291 tempest-ServersAdminTestJSON-344211291-project] Getting quotas for project ef4e03cedfa24337a14b428696d78047. Resources: {'instances', 'cores', 'ram'} {{(pid=94358) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 21 10:40:32.530497 n-d-811414-3 nova-conductor[94358]: DEBUG nova.quota [None req-0b03cf24-47f5-49ef-a20b-f1989115c95f tempest-ServersAdminTestJSON-344211291 tempest-ServersAdminTestJSON-344211291-project] Getting quotas for user b000034dc6504c5088ae98b4709f4fc1 and project ef4e03cedfa24337a14b428696d78047. Resources: {'instances', 'cores', 'ram'} {{(pid=94358) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 21 10:40:32.542921 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-0b03cf24-47f5-49ef-a20b-f1989115c95f tempest-ServersAdminTestJSON-344211291 tempest-ServersAdminTestJSON-344211291-project] [instance: 5ea9163f-6ebd-42cc-a99b-6d59a6eef6d6] Selected host: n-h1-811414-3; Selected node: n-h1-811414-3; Alternates: [] {{(pid=94358) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 21 10:40:32.543968 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-0b03cf24-47f5-49ef-a20b-f1989115c95f tempest-ServersAdminTestJSON-344211291 tempest-ServersAdminTestJSON-344211291-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:40:32.544442 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-0b03cf24-47f5-49ef-a20b-f1989115c95f tempest-ServersAdminTestJSON-344211291 tempest-ServersAdminTestJSON-344211291-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:40:32.555156 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-0b03cf24-47f5-49ef-a20b-f1989115c95f tempest-ServersAdminTestJSON-344211291 tempest-ServersAdminTestJSON-344211291-project] [instance: 5ea9163f-6ebd-42cc-a99b-6d59a6eef6d6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f5cdc3d5-9524-4220-a7fc-ab5606975fdb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94358) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 21 10:40:32.556735 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-0b03cf24-47f5-49ef-a20b-f1989115c95f tempest-ServersAdminTestJSON-344211291 tempest-ServersAdminTestJSON-344211291-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:40:32.557333 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-0b03cf24-47f5-49ef-a20b-f1989115c95f tempest-ServersAdminTestJSON-344211291 tempest-ServersAdminTestJSON-344211291-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:40:32.591609 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-0b03cf24-47f5-49ef-a20b-f1989115c95f tempest-ServersAdminTestJSON-344211291 tempest-ServersAdminTestJSON-344211291-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:40:32.592852 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-0b03cf24-47f5-49ef-a20b-f1989115c95f tempest-ServersAdminTestJSON-344211291 tempest-ServersAdminTestJSON-344211291-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:40:38.917834 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-d46b81d6-20e1-4d2b-aca9-34cc281b0bd5 tempest-ServersAdminNegativeTestJSON-1103264428 tempest-ServersAdminNegativeTestJSON-1103264428-project] Took 0.36 seconds to select destinations for 1 instance(s). {{(pid=94357) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 21 10:40:38.943603 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-68ef874e-35ef-4580-befc-a21d52d93f47 tempest-LiveAutoBlockMigrationV225Test-525213650 tempest-LiveAutoBlockMigrationV225Test-525213650-project-admin] Targeting cell 6c99d8ec-fb48-48af-b02b-a629a7c2cb6b(cell1) for conductor method migrate_server {{(pid=94358) wrapper /opt/stack/nova/nova/conductor/manager.py:91}} Apr 21 10:40:38.946553 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-68ef874e-35ef-4580-befc-a21d52d93f47 tempest-LiveAutoBlockMigrationV225Test-525213650 tempest-LiveAutoBlockMigrationV225Test-525213650-project-admin] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:40:38.947704 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-68ef874e-35ef-4580-befc-a21d52d93f47 tempest-LiveAutoBlockMigrationV225Test-525213650 tempest-LiveAutoBlockMigrationV225Test-525213650-project-admin] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:40:38.985984 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-d46b81d6-20e1-4d2b-aca9-34cc281b0bd5 tempest-ServersAdminNegativeTestJSON-1103264428 tempest-ServersAdminNegativeTestJSON-1103264428-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:40:38.987033 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-d46b81d6-20e1-4d2b-aca9-34cc281b0bd5 tempest-ServersAdminNegativeTestJSON-1103264428 tempest-ServersAdminNegativeTestJSON-1103264428-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:40:39.086099 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-d46b81d6-20e1-4d2b-aca9-34cc281b0bd5 tempest-ServersAdminNegativeTestJSON-1103264428 tempest-ServersAdminNegativeTestJSON-1103264428-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:40:39.086513 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-d46b81d6-20e1-4d2b-aca9-34cc281b0bd5 tempest-ServersAdminNegativeTestJSON-1103264428 tempest-ServersAdminNegativeTestJSON-1103264428-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:40:39.087246 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-d46b81d6-20e1-4d2b-aca9-34cc281b0bd5 tempest-ServersAdminNegativeTestJSON-1103264428 tempest-ServersAdminNegativeTestJSON-1103264428-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:40:39.087640 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-d46b81d6-20e1-4d2b-aca9-34cc281b0bd5 tempest-ServersAdminNegativeTestJSON-1103264428 tempest-ServersAdminNegativeTestJSON-1103264428-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:40:39.126062 n-d-811414-3 nova-conductor[94357]: DEBUG nova.quota [None req-d46b81d6-20e1-4d2b-aca9-34cc281b0bd5 tempest-ServersAdminNegativeTestJSON-1103264428 tempest-ServersAdminNegativeTestJSON-1103264428-project] Getting quotas for project 55925eecd3724a94bfb4d494919e6c24. Resources: {'instances', 'cores', 'ram'} {{(pid=94357) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 21 10:40:39.131525 n-d-811414-3 nova-conductor[94357]: DEBUG nova.quota [None req-d46b81d6-20e1-4d2b-aca9-34cc281b0bd5 tempest-ServersAdminNegativeTestJSON-1103264428 tempest-ServersAdminNegativeTestJSON-1103264428-project] Getting quotas for user 4242975c26674c808e94773e18a81be8 and project 55925eecd3724a94bfb4d494919e6c24. Resources: {'instances', 'cores', 'ram'} {{(pid=94357) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 21 10:40:39.162949 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-d46b81d6-20e1-4d2b-aca9-34cc281b0bd5 tempest-ServersAdminNegativeTestJSON-1103264428 tempest-ServersAdminNegativeTestJSON-1103264428-project] [instance: e155ea06-4904-44d1-a0a1-b5d127d7b6ee] Selected host: n-h2-811414-3; Selected node: n-h2-811414-3; Alternates: [('n-h1-811414-3', 'n-h1-811414-3')] {{(pid=94357) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 21 10:40:39.164539 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-d46b81d6-20e1-4d2b-aca9-34cc281b0bd5 tempest-ServersAdminNegativeTestJSON-1103264428 tempest-ServersAdminNegativeTestJSON-1103264428-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:40:39.165381 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-d46b81d6-20e1-4d2b-aca9-34cc281b0bd5 tempest-ServersAdminNegativeTestJSON-1103264428 tempest-ServersAdminNegativeTestJSON-1103264428-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:40:39.178975 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-d46b81d6-20e1-4d2b-aca9-34cc281b0bd5 tempest-ServersAdminNegativeTestJSON-1103264428 tempest-ServersAdminNegativeTestJSON-1103264428-project] [instance: e155ea06-4904-44d1-a0a1-b5d127d7b6ee] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f5cdc3d5-9524-4220-a7fc-ab5606975fdb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94357) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 21 10:40:39.183814 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-d46b81d6-20e1-4d2b-aca9-34cc281b0bd5 tempest-ServersAdminNegativeTestJSON-1103264428 tempest-ServersAdminNegativeTestJSON-1103264428-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:40:39.184364 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-d46b81d6-20e1-4d2b-aca9-34cc281b0bd5 tempest-ServersAdminNegativeTestJSON-1103264428 tempest-ServersAdminNegativeTestJSON-1103264428-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:40:39.253851 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-d46b81d6-20e1-4d2b-aca9-34cc281b0bd5 tempest-ServersAdminNegativeTestJSON-1103264428 tempest-ServersAdminNegativeTestJSON-1103264428-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:40:39.254776 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-d46b81d6-20e1-4d2b-aca9-34cc281b0bd5 tempest-ServersAdminNegativeTestJSON-1103264428 tempest-ServersAdminNegativeTestJSON-1103264428-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:40:39.450344 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.tasks.migrate [None req-68ef874e-35ef-4580-befc-a21d52d93f47 tempest-LiveAutoBlockMigrationV225Test-525213650 tempest-LiveAutoBlockMigrationV225Test-525213650-project-admin] Created allocations for migration d6f7fc13-aad3-483b-bd19-9d7f04614dd1 on 6ea3f8b1-0c53-40ba-ba27-f80f78a284a6 {{(pid=94358) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} Apr 21 10:40:39.634956 n-d-811414-3 nova-conductor[94358]: DEBUG nova.scheduler.utils [None req-68ef874e-35ef-4580-befc-a21d52d93f47 tempest-LiveAutoBlockMigrationV225Test-525213650 tempest-LiveAutoBlockMigrationV225Test-525213650-project-admin] [instance: 0467c92f-b8ca-4ab6-960c-b25b1b4bf7cd] Instance allocations successfully created on destination node 43480f3a-fb09-463e-8326-6927c98a38b4: {'allocations': {'43480f3a-fb09-463e-8326-6927c98a38b4': {'resources': {'VCPU': 1, 'MEMORY_MB': 1024, 'DISK_GB': 1}}}} {{(pid=94358) claim_resources_on_destination /opt/stack/nova/nova/scheduler/utils.py:827}} Apr 21 10:40:39.635444 n-d-811414-3 nova-conductor[94358]: DEBUG nova.objects.instance [None req-68ef874e-35ef-4580-befc-a21d52d93f47 tempest-LiveAutoBlockMigrationV225Test-525213650 tempest-LiveAutoBlockMigrationV225Test-525213650-project-admin] Lazy-loading 'resources' on Instance uuid 0467c92f-b8ca-4ab6-960c-b25b1b4bf7cd {{(pid=94358) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Apr 21 10:40:39.642449 n-d-811414-3 nova-conductor[94358]: DEBUG nova.objects.instance [None req-68ef874e-35ef-4580-befc-a21d52d93f47 tempest-LiveAutoBlockMigrationV225Test-525213650 tempest-LiveAutoBlockMigrationV225Test-525213650-project-admin] Lazy-loading 'pci_requests' on Instance uuid 0467c92f-b8ca-4ab6-960c-b25b1b4bf7cd {{(pid=94358) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Apr 21 10:40:40.073224 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.tasks.live_migrate [None req-68ef874e-35ef-4580-befc-a21d52d93f47 tempest-LiveAutoBlockMigrationV225Test-525213650 tempest-LiveAutoBlockMigrationV225Test-525213650-project-admin] [instance: 0467c92f-b8ca-4ab6-960c-b25b1b4bf7cd] Start binding ports on destination host: n-h1-811414-3 {{(pid=94358) _bind_ports_on_destination /opt/stack/nova/nova/conductor/tasks/live_migrate.py:389}} Apr 21 10:40:47.978137 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-acd41dd0-5df7-4781-8e9b-898d98271e37 tempest-LiveMigrationTest-854730834 tempest-LiveMigrationTest-854730834-project] Took 0.27 seconds to select destinations for 1 instance(s). {{(pid=94357) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 21 10:40:48.004606 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-acd41dd0-5df7-4781-8e9b-898d98271e37 tempest-LiveMigrationTest-854730834 tempest-LiveMigrationTest-854730834-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:40:48.005114 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-acd41dd0-5df7-4781-8e9b-898d98271e37 tempest-LiveMigrationTest-854730834 tempest-LiveMigrationTest-854730834-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:40:48.059231 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-acd41dd0-5df7-4781-8e9b-898d98271e37 tempest-LiveMigrationTest-854730834 tempest-LiveMigrationTest-854730834-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:40:48.059633 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-acd41dd0-5df7-4781-8e9b-898d98271e37 tempest-LiveMigrationTest-854730834 tempest-LiveMigrationTest-854730834-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:40:48.060995 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-acd41dd0-5df7-4781-8e9b-898d98271e37 tempest-LiveMigrationTest-854730834 tempest-LiveMigrationTest-854730834-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:40:48.061551 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-acd41dd0-5df7-4781-8e9b-898d98271e37 tempest-LiveMigrationTest-854730834 tempest-LiveMigrationTest-854730834-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:40:48.081347 n-d-811414-3 nova-conductor[94357]: DEBUG nova.quota [None req-acd41dd0-5df7-4781-8e9b-898d98271e37 tempest-LiveMigrationTest-854730834 tempest-LiveMigrationTest-854730834-project] Getting quotas for project 827d444119b94ef6a099b8cf4c6a10ba. Resources: {'instances', 'cores', 'ram'} {{(pid=94357) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 21 10:40:48.086851 n-d-811414-3 nova-conductor[94357]: DEBUG nova.quota [None req-acd41dd0-5df7-4781-8e9b-898d98271e37 tempest-LiveMigrationTest-854730834 tempest-LiveMigrationTest-854730834-project] Getting quotas for user 8b0079bf33b34e3cb121c2ea48a694fc and project 827d444119b94ef6a099b8cf4c6a10ba. Resources: {'instances', 'cores', 'ram'} {{(pid=94357) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 21 10:40:48.099444 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-acd41dd0-5df7-4781-8e9b-898d98271e37 tempest-LiveMigrationTest-854730834 tempest-LiveMigrationTest-854730834-project] [instance: 19dc826a-02e9-4094-ba0a-dfa25619ed80] Selected host: n-h1-811414-3; Selected node: n-h1-811414-3; Alternates: [('n-h2-811414-3', 'n-h2-811414-3')] {{(pid=94357) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 21 10:40:48.100721 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-acd41dd0-5df7-4781-8e9b-898d98271e37 tempest-LiveMigrationTest-854730834 tempest-LiveMigrationTest-854730834-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:40:48.101279 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-acd41dd0-5df7-4781-8e9b-898d98271e37 tempest-LiveMigrationTest-854730834 tempest-LiveMigrationTest-854730834-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:40:48.109432 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-acd41dd0-5df7-4781-8e9b-898d98271e37 tempest-LiveMigrationTest-854730834 tempest-LiveMigrationTest-854730834-project] [instance: 19dc826a-02e9-4094-ba0a-dfa25619ed80] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f5cdc3d5-9524-4220-a7fc-ab5606975fdb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94357) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 21 10:40:48.111329 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-acd41dd0-5df7-4781-8e9b-898d98271e37 tempest-LiveMigrationTest-854730834 tempest-LiveMigrationTest-854730834-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:40:48.111960 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-acd41dd0-5df7-4781-8e9b-898d98271e37 tempest-LiveMigrationTest-854730834 tempest-LiveMigrationTest-854730834-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:40:48.151133 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-acd41dd0-5df7-4781-8e9b-898d98271e37 tempest-LiveMigrationTest-854730834 tempest-LiveMigrationTest-854730834-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:40:48.151732 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-acd41dd0-5df7-4781-8e9b-898d98271e37 tempest-LiveMigrationTest-854730834 tempest-LiveMigrationTest-854730834-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:41:05.840985 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-3f9ee71c-ca07-4018-a1ac-b176d1bb8543 tempest-LiveAutoBlockMigrationV225Test-499396072 tempest-LiveAutoBlockMigrationV225Test-499396072-project] Took 0.40 seconds to select destinations for 1 instance(s). {{(pid=94358) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 21 10:41:05.917250 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-3f9ee71c-ca07-4018-a1ac-b176d1bb8543 tempest-LiveAutoBlockMigrationV225Test-499396072 tempest-LiveAutoBlockMigrationV225Test-499396072-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:41:05.917659 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-3f9ee71c-ca07-4018-a1ac-b176d1bb8543 tempest-LiveAutoBlockMigrationV225Test-499396072 tempest-LiveAutoBlockMigrationV225Test-499396072-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:41:05.953761 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-8610325b-1ff7-4db3-9b4d-9947aacee511 tempest-FloatingIPsAssociationTestJSON-1857590090 tempest-FloatingIPsAssociationTestJSON-1857590090-project] Took 0.47 seconds to select destinations for 1 instance(s). {{(pid=94357) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 21 10:41:05.983358 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-8610325b-1ff7-4db3-9b4d-9947aacee511 tempest-FloatingIPsAssociationTestJSON-1857590090 tempest-FloatingIPsAssociationTestJSON-1857590090-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:41:05.984445 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-8610325b-1ff7-4db3-9b4d-9947aacee511 tempest-FloatingIPsAssociationTestJSON-1857590090 tempest-FloatingIPsAssociationTestJSON-1857590090-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:41:06.010538 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-3f9ee71c-ca07-4018-a1ac-b176d1bb8543 tempest-LiveAutoBlockMigrationV225Test-499396072 tempest-LiveAutoBlockMigrationV225Test-499396072-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:41:06.011687 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-3f9ee71c-ca07-4018-a1ac-b176d1bb8543 tempest-LiveAutoBlockMigrationV225Test-499396072 tempest-LiveAutoBlockMigrationV225Test-499396072-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:41:06.013389 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-3f9ee71c-ca07-4018-a1ac-b176d1bb8543 tempest-LiveAutoBlockMigrationV225Test-499396072 tempest-LiveAutoBlockMigrationV225Test-499396072-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:41:06.013946 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-3f9ee71c-ca07-4018-a1ac-b176d1bb8543 tempest-LiveAutoBlockMigrationV225Test-499396072 tempest-LiveAutoBlockMigrationV225Test-499396072-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:41:06.054593 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-8610325b-1ff7-4db3-9b4d-9947aacee511 tempest-FloatingIPsAssociationTestJSON-1857590090 tempest-FloatingIPsAssociationTestJSON-1857590090-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:41:06.055512 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-8610325b-1ff7-4db3-9b4d-9947aacee511 tempest-FloatingIPsAssociationTestJSON-1857590090 tempest-FloatingIPsAssociationTestJSON-1857590090-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:41:06.056814 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-8610325b-1ff7-4db3-9b4d-9947aacee511 tempest-FloatingIPsAssociationTestJSON-1857590090 tempest-FloatingIPsAssociationTestJSON-1857590090-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:41:06.057882 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-8610325b-1ff7-4db3-9b4d-9947aacee511 tempest-FloatingIPsAssociationTestJSON-1857590090 tempest-FloatingIPsAssociationTestJSON-1857590090-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:41:06.078669 n-d-811414-3 nova-conductor[94358]: DEBUG nova.quota [None req-3f9ee71c-ca07-4018-a1ac-b176d1bb8543 tempest-LiveAutoBlockMigrationV225Test-499396072 tempest-LiveAutoBlockMigrationV225Test-499396072-project] Getting quotas for project a5d2c091696a4f63867bc69db107ba91. Resources: {'instances', 'cores', 'ram'} {{(pid=94358) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 21 10:41:06.086632 n-d-811414-3 nova-conductor[94358]: DEBUG nova.quota [None req-3f9ee71c-ca07-4018-a1ac-b176d1bb8543 tempest-LiveAutoBlockMigrationV225Test-499396072 tempest-LiveAutoBlockMigrationV225Test-499396072-project] Getting quotas for user 5b64c5ff88744287b5a5cf822fbbf185 and project a5d2c091696a4f63867bc69db107ba91. Resources: {'instances', 'cores', 'ram'} {{(pid=94358) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 21 10:41:06.100034 n-d-811414-3 nova-conductor[94357]: DEBUG nova.quota [None req-8610325b-1ff7-4db3-9b4d-9947aacee511 tempest-FloatingIPsAssociationTestJSON-1857590090 tempest-FloatingIPsAssociationTestJSON-1857590090-project] Getting quotas for project d24ca98ae09548669e26fc7f5e2a508f. Resources: {'instances', 'cores', 'ram'} {{(pid=94357) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 21 10:41:06.106032 n-d-811414-3 nova-conductor[94357]: DEBUG nova.quota [None req-8610325b-1ff7-4db3-9b4d-9947aacee511 tempest-FloatingIPsAssociationTestJSON-1857590090 tempest-FloatingIPsAssociationTestJSON-1857590090-project] Getting quotas for user aa4ccaa3165249ffb9d4f3a1ee66d407 and project d24ca98ae09548669e26fc7f5e2a508f. Resources: {'instances', 'cores', 'ram'} {{(pid=94357) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 21 10:41:06.112041 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-3f9ee71c-ca07-4018-a1ac-b176d1bb8543 tempest-LiveAutoBlockMigrationV225Test-499396072 tempest-LiveAutoBlockMigrationV225Test-499396072-project] [instance: e060b6bb-6b4a-462a-a29a-c2a2f1d3c5fd] Selected host: n-h2-811414-3; Selected node: n-h2-811414-3; Alternates: [('n-h1-811414-3', 'n-h1-811414-3')] {{(pid=94358) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 21 10:41:06.113018 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-3f9ee71c-ca07-4018-a1ac-b176d1bb8543 tempest-LiveAutoBlockMigrationV225Test-499396072 tempest-LiveAutoBlockMigrationV225Test-499396072-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:41:06.113407 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-3f9ee71c-ca07-4018-a1ac-b176d1bb8543 tempest-LiveAutoBlockMigrationV225Test-499396072 tempest-LiveAutoBlockMigrationV225Test-499396072-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:41:06.128889 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-3f9ee71c-ca07-4018-a1ac-b176d1bb8543 tempest-LiveAutoBlockMigrationV225Test-499396072 tempest-LiveAutoBlockMigrationV225Test-499396072-project] [instance: e060b6bb-6b4a-462a-a29a-c2a2f1d3c5fd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f5cdc3d5-9524-4220-a7fc-ab5606975fdb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94358) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 21 10:41:06.130125 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-3f9ee71c-ca07-4018-a1ac-b176d1bb8543 tempest-LiveAutoBlockMigrationV225Test-499396072 tempest-LiveAutoBlockMigrationV225Test-499396072-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:41:06.130519 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-3f9ee71c-ca07-4018-a1ac-b176d1bb8543 tempest-LiveAutoBlockMigrationV225Test-499396072 tempest-LiveAutoBlockMigrationV225Test-499396072-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:41:06.133775 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-8610325b-1ff7-4db3-9b4d-9947aacee511 tempest-FloatingIPsAssociationTestJSON-1857590090 tempest-FloatingIPsAssociationTestJSON-1857590090-project] [instance: 763bbc0d-69b8-40bf-86f5-f0fce42b7aaa] Selected host: n-h2-811414-3; Selected node: n-h2-811414-3; Alternates: [('n-h1-811414-3', 'n-h1-811414-3')] {{(pid=94357) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 21 10:41:06.135739 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-8610325b-1ff7-4db3-9b4d-9947aacee511 tempest-FloatingIPsAssociationTestJSON-1857590090 tempest-FloatingIPsAssociationTestJSON-1857590090-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:41:06.136794 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-8610325b-1ff7-4db3-9b4d-9947aacee511 tempest-FloatingIPsAssociationTestJSON-1857590090 tempest-FloatingIPsAssociationTestJSON-1857590090-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:41:06.153627 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-8610325b-1ff7-4db3-9b4d-9947aacee511 tempest-FloatingIPsAssociationTestJSON-1857590090 tempest-FloatingIPsAssociationTestJSON-1857590090-project] [instance: 763bbc0d-69b8-40bf-86f5-f0fce42b7aaa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f5cdc3d5-9524-4220-a7fc-ab5606975fdb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94357) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 21 10:41:06.156201 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-8610325b-1ff7-4db3-9b4d-9947aacee511 tempest-FloatingIPsAssociationTestJSON-1857590090 tempest-FloatingIPsAssociationTestJSON-1857590090-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:41:06.156201 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-8610325b-1ff7-4db3-9b4d-9947aacee511 tempest-FloatingIPsAssociationTestJSON-1857590090 tempest-FloatingIPsAssociationTestJSON-1857590090-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:41:06.189111 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-3f9ee71c-ca07-4018-a1ac-b176d1bb8543 tempest-LiveAutoBlockMigrationV225Test-499396072 tempest-LiveAutoBlockMigrationV225Test-499396072-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:41:06.189514 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-3f9ee71c-ca07-4018-a1ac-b176d1bb8543 tempest-LiveAutoBlockMigrationV225Test-499396072 tempest-LiveAutoBlockMigrationV225Test-499396072-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:41:06.221691 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-8610325b-1ff7-4db3-9b4d-9947aacee511 tempest-FloatingIPsAssociationTestJSON-1857590090 tempest-FloatingIPsAssociationTestJSON-1857590090-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:41:06.222733 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-8610325b-1ff7-4db3-9b4d-9947aacee511 tempest-FloatingIPsAssociationTestJSON-1857590090 tempest-FloatingIPsAssociationTestJSON-1857590090-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:41:18.111818 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-01dc5822-4178-411d-b0e6-47deb4effd75 tempest-ServersAdminTestJSON-344211291 tempest-ServersAdminTestJSON-344211291-project] Targeting cell 6c99d8ec-fb48-48af-b02b-a629a7c2cb6b(cell1) for conductor method rebuild_instance {{(pid=94358) wrapper /opt/stack/nova/nova/conductor/manager.py:91}} Apr 21 10:41:18.113821 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-01dc5822-4178-411d-b0e6-47deb4effd75 tempest-ServersAdminTestJSON-344211291 tempest-ServersAdminTestJSON-344211291-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:41:18.117822 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-01dc5822-4178-411d-b0e6-47deb4effd75 tempest-ServersAdminTestJSON-344211291 tempest-ServersAdminTestJSON-344211291-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:41:18.178941 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-01dc5822-4178-411d-b0e6-47deb4effd75 tempest-ServersAdminTestJSON-344211291 tempest-ServersAdminTestJSON-344211291-project] [instance: 1d3b2b74-673e-461b-b458-2c0d82f2fd73] No migration record for the rebuild/evacuate request. {{(pid=94358) rebuild_instance /opt/stack/nova/nova/conductor/manager.py:1101}} Apr 21 10:41:24.441721 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-cc486062-5314-4632-ac40-caed86e44cbc tempest-FloatingIPsAssociationTestJSON-1857590090 tempest-FloatingIPsAssociationTestJSON-1857590090-project] Took 0.56 seconds to select destinations for 1 instance(s). {{(pid=94357) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 21 10:41:24.489814 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-cc486062-5314-4632-ac40-caed86e44cbc tempest-FloatingIPsAssociationTestJSON-1857590090 tempest-FloatingIPsAssociationTestJSON-1857590090-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:41:24.490216 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-cc486062-5314-4632-ac40-caed86e44cbc tempest-FloatingIPsAssociationTestJSON-1857590090 tempest-FloatingIPsAssociationTestJSON-1857590090-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:41:24.575871 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-cc486062-5314-4632-ac40-caed86e44cbc tempest-FloatingIPsAssociationTestJSON-1857590090 tempest-FloatingIPsAssociationTestJSON-1857590090-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:41:24.576179 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-cc486062-5314-4632-ac40-caed86e44cbc tempest-FloatingIPsAssociationTestJSON-1857590090 tempest-FloatingIPsAssociationTestJSON-1857590090-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:41:24.576920 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-cc486062-5314-4632-ac40-caed86e44cbc tempest-FloatingIPsAssociationTestJSON-1857590090 tempest-FloatingIPsAssociationTestJSON-1857590090-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:41:24.577308 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-cc486062-5314-4632-ac40-caed86e44cbc tempest-FloatingIPsAssociationTestJSON-1857590090 tempest-FloatingIPsAssociationTestJSON-1857590090-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:41:24.614625 n-d-811414-3 nova-conductor[94357]: DEBUG nova.quota [None req-cc486062-5314-4632-ac40-caed86e44cbc tempest-FloatingIPsAssociationTestJSON-1857590090 tempest-FloatingIPsAssociationTestJSON-1857590090-project] Getting quotas for project d24ca98ae09548669e26fc7f5e2a508f. Resources: {'instances', 'cores', 'ram'} {{(pid=94357) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 21 10:41:24.618845 n-d-811414-3 nova-conductor[94357]: DEBUG nova.quota [None req-cc486062-5314-4632-ac40-caed86e44cbc tempest-FloatingIPsAssociationTestJSON-1857590090 tempest-FloatingIPsAssociationTestJSON-1857590090-project] Getting quotas for user aa4ccaa3165249ffb9d4f3a1ee66d407 and project d24ca98ae09548669e26fc7f5e2a508f. Resources: {'instances', 'cores', 'ram'} {{(pid=94357) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 21 10:41:24.641374 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-cc486062-5314-4632-ac40-caed86e44cbc tempest-FloatingIPsAssociationTestJSON-1857590090 tempest-FloatingIPsAssociationTestJSON-1857590090-project] [instance: 6e5730c1-fe37-40b6-9702-b18526df5b9e] Selected host: n-h2-811414-3; Selected node: n-h2-811414-3; Alternates: [('n-h1-811414-3', 'n-h1-811414-3')] {{(pid=94357) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 21 10:41:24.642311 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-cc486062-5314-4632-ac40-caed86e44cbc tempest-FloatingIPsAssociationTestJSON-1857590090 tempest-FloatingIPsAssociationTestJSON-1857590090-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:41:24.642705 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-cc486062-5314-4632-ac40-caed86e44cbc tempest-FloatingIPsAssociationTestJSON-1857590090 tempest-FloatingIPsAssociationTestJSON-1857590090-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:41:24.666422 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-cc486062-5314-4632-ac40-caed86e44cbc tempest-FloatingIPsAssociationTestJSON-1857590090 tempest-FloatingIPsAssociationTestJSON-1857590090-project] [instance: 6e5730c1-fe37-40b6-9702-b18526df5b9e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f5cdc3d5-9524-4220-a7fc-ab5606975fdb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94357) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 21 10:41:24.667701 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-cc486062-5314-4632-ac40-caed86e44cbc tempest-FloatingIPsAssociationTestJSON-1857590090 tempest-FloatingIPsAssociationTestJSON-1857590090-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:41:24.668234 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-cc486062-5314-4632-ac40-caed86e44cbc tempest-FloatingIPsAssociationTestJSON-1857590090 tempest-FloatingIPsAssociationTestJSON-1857590090-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:41:24.723708 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-cc486062-5314-4632-ac40-caed86e44cbc tempest-FloatingIPsAssociationTestJSON-1857590090 tempest-FloatingIPsAssociationTestJSON-1857590090-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:41:24.724407 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-cc486062-5314-4632-ac40-caed86e44cbc tempest-FloatingIPsAssociationTestJSON-1857590090 tempest-FloatingIPsAssociationTestJSON-1857590090-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:41:29.194239 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-b17bc173-9b11-43ad-9ed8-971c999cfda5 tempest-LiveMigrationTest-1685226576 tempest-LiveMigrationTest-1685226576-project-admin] Targeting cell 6c99d8ec-fb48-48af-b02b-a629a7c2cb6b(cell1) for conductor method migrate_server {{(pid=94358) wrapper /opt/stack/nova/nova/conductor/manager.py:91}} Apr 21 10:41:29.194832 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-b17bc173-9b11-43ad-9ed8-971c999cfda5 tempest-LiveMigrationTest-1685226576 tempest-LiveMigrationTest-1685226576-project-admin] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:41:29.195688 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-b17bc173-9b11-43ad-9ed8-971c999cfda5 tempest-LiveMigrationTest-1685226576 tempest-LiveMigrationTest-1685226576-project-admin] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:41:29.678870 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.tasks.migrate [None req-b17bc173-9b11-43ad-9ed8-971c999cfda5 tempest-LiveMigrationTest-1685226576 tempest-LiveMigrationTest-1685226576-project-admin] Created allocations for migration 1d32d181-f61d-48ab-92a0-eb6d6a9a424c on 43480f3a-fb09-463e-8326-6927c98a38b4 {{(pid=94358) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} Apr 21 10:41:29.795648 n-d-811414-3 nova-conductor[94358]: DEBUG nova.scheduler.utils [None req-b17bc173-9b11-43ad-9ed8-971c999cfda5 tempest-LiveMigrationTest-1685226576 tempest-LiveMigrationTest-1685226576-project-admin] [instance: 19dc826a-02e9-4094-ba0a-dfa25619ed80] Instance allocations successfully created on destination node 6ea3f8b1-0c53-40ba-ba27-f80f78a284a6: {'allocations': {'6ea3f8b1-0c53-40ba-ba27-f80f78a284a6': {'resources': {'VCPU': 1, 'MEMORY_MB': 1024, 'DISK_GB': 1}}}} {{(pid=94358) claim_resources_on_destination /opt/stack/nova/nova/scheduler/utils.py:827}} Apr 21 10:41:29.796241 n-d-811414-3 nova-conductor[94358]: DEBUG nova.objects.instance [None req-b17bc173-9b11-43ad-9ed8-971c999cfda5 tempest-LiveMigrationTest-1685226576 tempest-LiveMigrationTest-1685226576-project-admin] Lazy-loading 'resources' on Instance uuid 19dc826a-02e9-4094-ba0a-dfa25619ed80 {{(pid=94358) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Apr 21 10:41:29.801484 n-d-811414-3 nova-conductor[94358]: DEBUG nova.objects.instance [None req-b17bc173-9b11-43ad-9ed8-971c999cfda5 tempest-LiveMigrationTest-1685226576 tempest-LiveMigrationTest-1685226576-project-admin] Lazy-loading 'pci_requests' on Instance uuid 19dc826a-02e9-4094-ba0a-dfa25619ed80 {{(pid=94358) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Apr 21 10:41:30.167365 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.tasks.live_migrate [None req-b17bc173-9b11-43ad-9ed8-971c999cfda5 tempest-LiveMigrationTest-1685226576 tempest-LiveMigrationTest-1685226576-project-admin] [instance: 19dc826a-02e9-4094-ba0a-dfa25619ed80] Start binding ports on destination host: n-h2-811414-3 {{(pid=94358) _bind_ports_on_destination /opt/stack/nova/nova/conductor/tasks/live_migrate.py:389}} Apr 21 10:41:31.710454 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-bf44ec1f-b6a4-4594-b2cf-122dd3cbb170 tempest-LiveAutoBlockMigrationV225Test-525213650 tempest-LiveAutoBlockMigrationV225Test-525213650-project-admin] Targeting cell 6c99d8ec-fb48-48af-b02b-a629a7c2cb6b(cell1) for conductor method migrate_server {{(pid=94357) wrapper /opt/stack/nova/nova/conductor/manager.py:91}} Apr 21 10:41:31.711873 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-bf44ec1f-b6a4-4594-b2cf-122dd3cbb170 tempest-LiveAutoBlockMigrationV225Test-525213650 tempest-LiveAutoBlockMigrationV225Test-525213650-project-admin] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:41:31.713156 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-bf44ec1f-b6a4-4594-b2cf-122dd3cbb170 tempest-LiveAutoBlockMigrationV225Test-525213650 tempest-LiveAutoBlockMigrationV225Test-525213650-project-admin] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:41:32.062366 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.tasks.migrate [None req-bf44ec1f-b6a4-4594-b2cf-122dd3cbb170 tempest-LiveAutoBlockMigrationV225Test-525213650 tempest-LiveAutoBlockMigrationV225Test-525213650-project-admin] Created allocations for migration 857be1c4-8c59-47a9-b223-c235e8f4dc89 on 6ea3f8b1-0c53-40ba-ba27-f80f78a284a6 {{(pid=94357) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} Apr 21 10:41:32.232260 n-d-811414-3 nova-conductor[94357]: DEBUG nova.scheduler.utils [None req-bf44ec1f-b6a4-4594-b2cf-122dd3cbb170 tempest-LiveAutoBlockMigrationV225Test-525213650 tempest-LiveAutoBlockMigrationV225Test-525213650-project-admin] [instance: e060b6bb-6b4a-462a-a29a-c2a2f1d3c5fd] Instance allocations successfully created on destination node 43480f3a-fb09-463e-8326-6927c98a38b4: {'allocations': {'43480f3a-fb09-463e-8326-6927c98a38b4': {'resources': {'VCPU': 1, 'MEMORY_MB': 1024, 'DISK_GB': 1}}}} {{(pid=94357) claim_resources_on_destination /opt/stack/nova/nova/scheduler/utils.py:827}} Apr 21 10:41:32.233253 n-d-811414-3 nova-conductor[94357]: DEBUG nova.objects.instance [None req-bf44ec1f-b6a4-4594-b2cf-122dd3cbb170 tempest-LiveAutoBlockMigrationV225Test-525213650 tempest-LiveAutoBlockMigrationV225Test-525213650-project-admin] Lazy-loading 'resources' on Instance uuid e060b6bb-6b4a-462a-a29a-c2a2f1d3c5fd {{(pid=94357) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Apr 21 10:41:32.238116 n-d-811414-3 nova-conductor[94357]: DEBUG nova.objects.instance [None req-bf44ec1f-b6a4-4594-b2cf-122dd3cbb170 tempest-LiveAutoBlockMigrationV225Test-525213650 tempest-LiveAutoBlockMigrationV225Test-525213650-project-admin] Lazy-loading 'pci_requests' on Instance uuid e060b6bb-6b4a-462a-a29a-c2a2f1d3c5fd {{(pid=94357) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Apr 21 10:41:32.667153 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.tasks.live_migrate [None req-bf44ec1f-b6a4-4594-b2cf-122dd3cbb170 tempest-LiveAutoBlockMigrationV225Test-525213650 tempest-LiveAutoBlockMigrationV225Test-525213650-project-admin] [instance: e060b6bb-6b4a-462a-a29a-c2a2f1d3c5fd] Start binding ports on destination host: n-h1-811414-3 {{(pid=94357) _bind_ports_on_destination /opt/stack/nova/nova/conductor/tasks/live_migrate.py:389}} Apr 21 10:41:53.591164 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-878aae3b-94ee-4361-9181-c5cdace426bd tempest-ImagesOneServerTestJSON-226361611 tempest-ImagesOneServerTestJSON-226361611-project] Took 0.45 seconds to select destinations for 1 instance(s). {{(pid=94358) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 21 10:41:53.635420 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-878aae3b-94ee-4361-9181-c5cdace426bd tempest-ImagesOneServerTestJSON-226361611 tempest-ImagesOneServerTestJSON-226361611-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:41:53.636144 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-878aae3b-94ee-4361-9181-c5cdace426bd tempest-ImagesOneServerTestJSON-226361611 tempest-ImagesOneServerTestJSON-226361611-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:41:53.699791 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-878aae3b-94ee-4361-9181-c5cdace426bd tempest-ImagesOneServerTestJSON-226361611 tempest-ImagesOneServerTestJSON-226361611-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:41:53.700633 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-878aae3b-94ee-4361-9181-c5cdace426bd tempest-ImagesOneServerTestJSON-226361611 tempest-ImagesOneServerTestJSON-226361611-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:41:53.702179 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-878aae3b-94ee-4361-9181-c5cdace426bd tempest-ImagesOneServerTestJSON-226361611 tempest-ImagesOneServerTestJSON-226361611-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:41:53.702762 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-878aae3b-94ee-4361-9181-c5cdace426bd tempest-ImagesOneServerTestJSON-226361611 tempest-ImagesOneServerTestJSON-226361611-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:41:53.730503 n-d-811414-3 nova-conductor[94358]: DEBUG nova.quota [None req-878aae3b-94ee-4361-9181-c5cdace426bd tempest-ImagesOneServerTestJSON-226361611 tempest-ImagesOneServerTestJSON-226361611-project] Getting quotas for project 7fdda346af4d4503a22c583b97675355. Resources: {'instances', 'cores', 'ram'} {{(pid=94358) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 21 10:41:53.739005 n-d-811414-3 nova-conductor[94358]: DEBUG nova.quota [None req-878aae3b-94ee-4361-9181-c5cdace426bd tempest-ImagesOneServerTestJSON-226361611 tempest-ImagesOneServerTestJSON-226361611-project] Getting quotas for user a4cdf0aa767846b6a0d3ebf9ed58362a and project 7fdda346af4d4503a22c583b97675355. Resources: {'instances', 'cores', 'ram'} {{(pid=94358) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 21 10:41:53.754797 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-878aae3b-94ee-4361-9181-c5cdace426bd tempest-ImagesOneServerTestJSON-226361611 tempest-ImagesOneServerTestJSON-226361611-project] [instance: bc5817a6-36ca-4d0a-bf1c-64d3c1138bca] Selected host: n-h1-811414-3; Selected node: n-h1-811414-3; Alternates: [('n-h2-811414-3', 'n-h2-811414-3')] {{(pid=94358) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 21 10:41:53.757020 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-878aae3b-94ee-4361-9181-c5cdace426bd tempest-ImagesOneServerTestJSON-226361611 tempest-ImagesOneServerTestJSON-226361611-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:41:53.757617 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-878aae3b-94ee-4361-9181-c5cdace426bd tempest-ImagesOneServerTestJSON-226361611 tempest-ImagesOneServerTestJSON-226361611-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:41:53.771955 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-878aae3b-94ee-4361-9181-c5cdace426bd tempest-ImagesOneServerTestJSON-226361611 tempest-ImagesOneServerTestJSON-226361611-project] [instance: bc5817a6-36ca-4d0a-bf1c-64d3c1138bca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f5cdc3d5-9524-4220-a7fc-ab5606975fdb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94358) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 21 10:41:53.776598 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-878aae3b-94ee-4361-9181-c5cdace426bd tempest-ImagesOneServerTestJSON-226361611 tempest-ImagesOneServerTestJSON-226361611-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:41:53.778446 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-878aae3b-94ee-4361-9181-c5cdace426bd tempest-ImagesOneServerTestJSON-226361611 tempest-ImagesOneServerTestJSON-226361611-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:41:53.818332 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-878aae3b-94ee-4361-9181-c5cdace426bd tempest-ImagesOneServerTestJSON-226361611 tempest-ImagesOneServerTestJSON-226361611-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:41:53.819292 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-878aae3b-94ee-4361-9181-c5cdace426bd tempest-ImagesOneServerTestJSON-226361611 tempest-ImagesOneServerTestJSON-226361611-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:41:57.647965 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-b7d40ada-30a7-43df-88b2-2b937a7aa27f tempest-ServersAdminTestJSON-344211291 tempest-ServersAdminTestJSON-344211291-project] Targeting cell 6c99d8ec-fb48-48af-b02b-a629a7c2cb6b(cell1) for conductor method rebuild_instance {{(pid=94357) wrapper /opt/stack/nova/nova/conductor/manager.py:91}} Apr 21 10:41:57.648811 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-b7d40ada-30a7-43df-88b2-2b937a7aa27f tempest-ServersAdminTestJSON-344211291 tempest-ServersAdminTestJSON-344211291-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:41:57.649215 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-b7d40ada-30a7-43df-88b2-2b937a7aa27f tempest-ServersAdminTestJSON-344211291 tempest-ServersAdminTestJSON-344211291-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:41:57.692485 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-b7d40ada-30a7-43df-88b2-2b937a7aa27f tempest-ServersAdminTestJSON-344211291 tempest-ServersAdminTestJSON-344211291-project] [instance: 1d3b2b74-673e-461b-b458-2c0d82f2fd73] No migration record for the rebuild/evacuate request. {{(pid=94357) rebuild_instance /opt/stack/nova/nova/conductor/manager.py:1101}} Apr 21 10:41:57.695982 n-d-811414-3 nova-conductor[94357]: ERROR oslo.messaging._drivers.impl_rabbit [None req-b7d40ada-30a7-43df-88b2-2b937a7aa27f tempest-ServersAdminTestJSON-344211291 tempest-ServersAdminTestJSON-344211291-project] [1c34e28c-d2e6-49c1-95f1-d320fdbab9cd] AMQP server on 10.222.0.13:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Apr 21 10:41:58.708824 n-d-811414-3 nova-conductor[94357]: INFO oslo.messaging._drivers.impl_rabbit [None req-b7d40ada-30a7-43df-88b2-2b937a7aa27f tempest-ServersAdminTestJSON-344211291 tempest-ServersAdminTestJSON-344211291-project] [1c34e28c-d2e6-49c1-95f1-d320fdbab9cd] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 40508. Apr 21 10:42:02.834478 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-72397ce2-5a83-46d6-8f00-2c42622b7bc3 tempest-LiveAutoBlockMigrationV225Test-499396072 tempest-LiveAutoBlockMigrationV225Test-499396072-project] Took 0.22 seconds to select destinations for 1 instance(s). {{(pid=94358) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 21 10:42:02.856903 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-72397ce2-5a83-46d6-8f00-2c42622b7bc3 tempest-LiveAutoBlockMigrationV225Test-499396072 tempest-LiveAutoBlockMigrationV225Test-499396072-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:42:02.857320 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-72397ce2-5a83-46d6-8f00-2c42622b7bc3 tempest-LiveAutoBlockMigrationV225Test-499396072 tempest-LiveAutoBlockMigrationV225Test-499396072-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:42:02.903726 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-72397ce2-5a83-46d6-8f00-2c42622b7bc3 tempest-LiveAutoBlockMigrationV225Test-499396072 tempest-LiveAutoBlockMigrationV225Test-499396072-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:42:02.904133 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-72397ce2-5a83-46d6-8f00-2c42622b7bc3 tempest-LiveAutoBlockMigrationV225Test-499396072 tempest-LiveAutoBlockMigrationV225Test-499396072-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:42:02.905093 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-72397ce2-5a83-46d6-8f00-2c42622b7bc3 tempest-LiveAutoBlockMigrationV225Test-499396072 tempest-LiveAutoBlockMigrationV225Test-499396072-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:42:02.905487 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-72397ce2-5a83-46d6-8f00-2c42622b7bc3 tempest-LiveAutoBlockMigrationV225Test-499396072 tempest-LiveAutoBlockMigrationV225Test-499396072-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:42:02.922099 n-d-811414-3 nova-conductor[94358]: DEBUG nova.quota [None req-72397ce2-5a83-46d6-8f00-2c42622b7bc3 tempest-LiveAutoBlockMigrationV225Test-499396072 tempest-LiveAutoBlockMigrationV225Test-499396072-project] Getting quotas for project a5d2c091696a4f63867bc69db107ba91. Resources: {'instances', 'cores', 'ram'} {{(pid=94358) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 21 10:42:02.926461 n-d-811414-3 nova-conductor[94358]: DEBUG nova.quota [None req-72397ce2-5a83-46d6-8f00-2c42622b7bc3 tempest-LiveAutoBlockMigrationV225Test-499396072 tempest-LiveAutoBlockMigrationV225Test-499396072-project] Getting quotas for user 5b64c5ff88744287b5a5cf822fbbf185 and project a5d2c091696a4f63867bc69db107ba91. Resources: {'instances', 'cores', 'ram'} {{(pid=94358) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 21 10:42:02.937532 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-72397ce2-5a83-46d6-8f00-2c42622b7bc3 tempest-LiveAutoBlockMigrationV225Test-499396072 tempest-LiveAutoBlockMigrationV225Test-499396072-project] [instance: d33973a8-5fcf-461a-87c9-5e3cf958f15d] Selected host: n-h2-811414-3; Selected node: n-h2-811414-3; Alternates: [('n-h1-811414-3', 'n-h1-811414-3')] {{(pid=94358) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 21 10:42:02.938598 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-72397ce2-5a83-46d6-8f00-2c42622b7bc3 tempest-LiveAutoBlockMigrationV225Test-499396072 tempest-LiveAutoBlockMigrationV225Test-499396072-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:42:02.939222 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-72397ce2-5a83-46d6-8f00-2c42622b7bc3 tempest-LiveAutoBlockMigrationV225Test-499396072 tempest-LiveAutoBlockMigrationV225Test-499396072-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:42:02.947245 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-72397ce2-5a83-46d6-8f00-2c42622b7bc3 tempest-LiveAutoBlockMigrationV225Test-499396072 tempest-LiveAutoBlockMigrationV225Test-499396072-project] [instance: d33973a8-5fcf-461a-87c9-5e3cf958f15d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f5cdc3d5-9524-4220-a7fc-ab5606975fdb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94358) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 21 10:42:02.953276 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-72397ce2-5a83-46d6-8f00-2c42622b7bc3 tempest-LiveAutoBlockMigrationV225Test-499396072 tempest-LiveAutoBlockMigrationV225Test-499396072-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:42:02.953866 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-72397ce2-5a83-46d6-8f00-2c42622b7bc3 tempest-LiveAutoBlockMigrationV225Test-499396072 tempest-LiveAutoBlockMigrationV225Test-499396072-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:42:02.982978 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-72397ce2-5a83-46d6-8f00-2c42622b7bc3 tempest-LiveAutoBlockMigrationV225Test-499396072 tempest-LiveAutoBlockMigrationV225Test-499396072-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:42:02.983454 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-72397ce2-5a83-46d6-8f00-2c42622b7bc3 tempest-LiveAutoBlockMigrationV225Test-499396072 tempest-LiveAutoBlockMigrationV225Test-499396072-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:42:42.172024 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-51d2dfc7-8810-4411-a632-697195799fd4 tempest-LiveMigrationTest-854730834 tempest-LiveMigrationTest-854730834-project] Took 0.34 seconds to select destinations for 1 instance(s). {{(pid=94357) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 21 10:42:42.216619 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-51d2dfc7-8810-4411-a632-697195799fd4 tempest-LiveMigrationTest-854730834 tempest-LiveMigrationTest-854730834-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:42:42.217488 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-51d2dfc7-8810-4411-a632-697195799fd4 tempest-LiveMigrationTest-854730834 tempest-LiveMigrationTest-854730834-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:42:42.323090 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-51d2dfc7-8810-4411-a632-697195799fd4 tempest-LiveMigrationTest-854730834 tempest-LiveMigrationTest-854730834-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:42:42.323594 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-51d2dfc7-8810-4411-a632-697195799fd4 tempest-LiveMigrationTest-854730834 tempest-LiveMigrationTest-854730834-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:42:42.324443 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-51d2dfc7-8810-4411-a632-697195799fd4 tempest-LiveMigrationTest-854730834 tempest-LiveMigrationTest-854730834-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:42:42.324867 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-51d2dfc7-8810-4411-a632-697195799fd4 tempest-LiveMigrationTest-854730834 tempest-LiveMigrationTest-854730834-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:42:42.361739 n-d-811414-3 nova-conductor[94357]: DEBUG nova.quota [None req-51d2dfc7-8810-4411-a632-697195799fd4 tempest-LiveMigrationTest-854730834 tempest-LiveMigrationTest-854730834-project] Getting quotas for project 827d444119b94ef6a099b8cf4c6a10ba. Resources: {'instances', 'cores', 'ram'} {{(pid=94357) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 21 10:42:42.379155 n-d-811414-3 nova-conductor[94357]: DEBUG nova.quota [None req-51d2dfc7-8810-4411-a632-697195799fd4 tempest-LiveMigrationTest-854730834 tempest-LiveMigrationTest-854730834-project] Getting quotas for user 8b0079bf33b34e3cb121c2ea48a694fc and project 827d444119b94ef6a099b8cf4c6a10ba. Resources: {'instances', 'cores', 'ram'} {{(pid=94357) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 21 10:42:42.403501 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-51d2dfc7-8810-4411-a632-697195799fd4 tempest-LiveMigrationTest-854730834 tempest-LiveMigrationTest-854730834-project] [instance: 17aa3c0a-b49e-4be7-bbc2-8a4fc618865c] Selected host: n-h2-811414-3; Selected node: n-h2-811414-3; Alternates: [('n-h1-811414-3', 'n-h1-811414-3')] {{(pid=94357) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 21 10:42:42.404487 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-51d2dfc7-8810-4411-a632-697195799fd4 tempest-LiveMigrationTest-854730834 tempest-LiveMigrationTest-854730834-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:42:42.404894 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-51d2dfc7-8810-4411-a632-697195799fd4 tempest-LiveMigrationTest-854730834 tempest-LiveMigrationTest-854730834-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:42:42.415703 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-51d2dfc7-8810-4411-a632-697195799fd4 tempest-LiveMigrationTest-854730834 tempest-LiveMigrationTest-854730834-project] [instance: 17aa3c0a-b49e-4be7-bbc2-8a4fc618865c] block_device_mapping [BlockDeviceMapping(attachment_id=fcd20796-e07f-452f-a78e-d373bdd5ae48,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ac2a1523-f95d-4b42-9b69-39369d508266',volume_size=1,volume_type=None)] {{(pid=94357) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 21 10:42:42.417877 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-51d2dfc7-8810-4411-a632-697195799fd4 tempest-LiveMigrationTest-854730834 tempest-LiveMigrationTest-854730834-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:42:42.418448 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-51d2dfc7-8810-4411-a632-697195799fd4 tempest-LiveMigrationTest-854730834 tempest-LiveMigrationTest-854730834-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:42:42.478044 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-51d2dfc7-8810-4411-a632-697195799fd4 tempest-LiveMigrationTest-854730834 tempest-LiveMigrationTest-854730834-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:42:42.478538 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-51d2dfc7-8810-4411-a632-697195799fd4 tempest-LiveMigrationTest-854730834 tempest-LiveMigrationTest-854730834-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:42:43.892716 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-e2f0acd3-255d-4363-8cc3-df97a0d1e5b6 tempest-MigrationsAdminTest-641231928 tempest-MigrationsAdminTest-641231928-project] Took 0.45 seconds to select destinations for 1 instance(s). {{(pid=94358) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 21 10:42:43.951980 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-e2f0acd3-255d-4363-8cc3-df97a0d1e5b6 tempest-MigrationsAdminTest-641231928 tempest-MigrationsAdminTest-641231928-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:42:43.952699 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-e2f0acd3-255d-4363-8cc3-df97a0d1e5b6 tempest-MigrationsAdminTest-641231928 tempest-MigrationsAdminTest-641231928-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:42:44.030831 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-e2f0acd3-255d-4363-8cc3-df97a0d1e5b6 tempest-MigrationsAdminTest-641231928 tempest-MigrationsAdminTest-641231928-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:42:44.031626 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-e2f0acd3-255d-4363-8cc3-df97a0d1e5b6 tempest-MigrationsAdminTest-641231928 tempest-MigrationsAdminTest-641231928-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:42:44.032607 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-e2f0acd3-255d-4363-8cc3-df97a0d1e5b6 tempest-MigrationsAdminTest-641231928 tempest-MigrationsAdminTest-641231928-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:42:44.033894 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-e2f0acd3-255d-4363-8cc3-df97a0d1e5b6 tempest-MigrationsAdminTest-641231928 tempest-MigrationsAdminTest-641231928-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:42:44.058054 n-d-811414-3 nova-conductor[94358]: DEBUG nova.quota [None req-e2f0acd3-255d-4363-8cc3-df97a0d1e5b6 tempest-MigrationsAdminTest-641231928 tempest-MigrationsAdminTest-641231928-project] Getting quotas for project eaa9a71aac0c466dbbfc09ba3cf71440. Resources: {'instances', 'cores', 'ram'} {{(pid=94358) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 21 10:42:44.065734 n-d-811414-3 nova-conductor[94358]: DEBUG nova.quota [None req-e2f0acd3-255d-4363-8cc3-df97a0d1e5b6 tempest-MigrationsAdminTest-641231928 tempest-MigrationsAdminTest-641231928-project] Getting quotas for user 521d609e0c8a430fa8f33c9db9870430 and project eaa9a71aac0c466dbbfc09ba3cf71440. Resources: {'instances', 'cores', 'ram'} {{(pid=94358) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 21 10:42:44.083938 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-e2f0acd3-255d-4363-8cc3-df97a0d1e5b6 tempest-MigrationsAdminTest-641231928 tempest-MigrationsAdminTest-641231928-project] [instance: 9da977c1-147d-4a20-a090-9ba7e1b401c0] Selected host: n-h1-811414-3; Selected node: n-h1-811414-3; Alternates: [('n-h2-811414-3', 'n-h2-811414-3')] {{(pid=94358) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 21 10:42:44.085810 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-e2f0acd3-255d-4363-8cc3-df97a0d1e5b6 tempest-MigrationsAdminTest-641231928 tempest-MigrationsAdminTest-641231928-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:42:44.086439 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-e2f0acd3-255d-4363-8cc3-df97a0d1e5b6 tempest-MigrationsAdminTest-641231928 tempest-MigrationsAdminTest-641231928-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:42:44.098503 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-e2f0acd3-255d-4363-8cc3-df97a0d1e5b6 tempest-MigrationsAdminTest-641231928 tempest-MigrationsAdminTest-641231928-project] [instance: 9da977c1-147d-4a20-a090-9ba7e1b401c0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f5cdc3d5-9524-4220-a7fc-ab5606975fdb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94358) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 21 10:42:44.100786 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-e2f0acd3-255d-4363-8cc3-df97a0d1e5b6 tempest-MigrationsAdminTest-641231928 tempest-MigrationsAdminTest-641231928-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:42:44.101571 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-e2f0acd3-255d-4363-8cc3-df97a0d1e5b6 tempest-MigrationsAdminTest-641231928 tempest-MigrationsAdminTest-641231928-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:42:44.170882 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-e2f0acd3-255d-4363-8cc3-df97a0d1e5b6 tempest-MigrationsAdminTest-641231928 tempest-MigrationsAdminTest-641231928-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:42:44.171405 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-e2f0acd3-255d-4363-8cc3-df97a0d1e5b6 tempest-MigrationsAdminTest-641231928 tempest-MigrationsAdminTest-641231928-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:42:48.540507 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-b36673b6-0f5e-47e4-a273-1383986e1fb9 tempest-LiveAutoBlockMigrationV225Test-525213650 tempest-LiveAutoBlockMigrationV225Test-525213650-project-admin] Targeting cell 6c99d8ec-fb48-48af-b02b-a629a7c2cb6b(cell1) for conductor method migrate_server {{(pid=94357) wrapper /opt/stack/nova/nova/conductor/manager.py:91}} Apr 21 10:42:48.546018 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-b36673b6-0f5e-47e4-a273-1383986e1fb9 tempest-LiveAutoBlockMigrationV225Test-525213650 tempest-LiveAutoBlockMigrationV225Test-525213650-project-admin] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:42:48.550132 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-b36673b6-0f5e-47e4-a273-1383986e1fb9 tempest-LiveAutoBlockMigrationV225Test-525213650 tempest-LiveAutoBlockMigrationV225Test-525213650-project-admin] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:42:49.301298 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.tasks.migrate [None req-b36673b6-0f5e-47e4-a273-1383986e1fb9 tempest-LiveAutoBlockMigrationV225Test-525213650 tempest-LiveAutoBlockMigrationV225Test-525213650-project-admin] Created allocations for migration 739f34cb-41af-4cba-9cc3-77036946b8f8 on 6ea3f8b1-0c53-40ba-ba27-f80f78a284a6 {{(pid=94357) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} Apr 21 10:42:49.501605 n-d-811414-3 nova-conductor[94357]: DEBUG nova.scheduler.utils [None req-b36673b6-0f5e-47e4-a273-1383986e1fb9 tempest-LiveAutoBlockMigrationV225Test-525213650 tempest-LiveAutoBlockMigrationV225Test-525213650-project-admin] [instance: d33973a8-5fcf-461a-87c9-5e3cf958f15d] Instance allocations successfully created on destination node 43480f3a-fb09-463e-8326-6927c98a38b4: {'allocations': {'43480f3a-fb09-463e-8326-6927c98a38b4': {'resources': {'VCPU': 1, 'MEMORY_MB': 1024, 'DISK_GB': 1}}}} {{(pid=94357) claim_resources_on_destination /opt/stack/nova/nova/scheduler/utils.py:827}} Apr 21 10:42:49.502435 n-d-811414-3 nova-conductor[94357]: DEBUG nova.objects.instance [None req-b36673b6-0f5e-47e4-a273-1383986e1fb9 tempest-LiveAutoBlockMigrationV225Test-525213650 tempest-LiveAutoBlockMigrationV225Test-525213650-project-admin] Lazy-loading 'resources' on Instance uuid d33973a8-5fcf-461a-87c9-5e3cf958f15d {{(pid=94357) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Apr 21 10:42:49.507243 n-d-811414-3 nova-conductor[94357]: DEBUG nova.objects.instance [None req-b36673b6-0f5e-47e4-a273-1383986e1fb9 tempest-LiveAutoBlockMigrationV225Test-525213650 tempest-LiveAutoBlockMigrationV225Test-525213650-project-admin] Lazy-loading 'pci_requests' on Instance uuid d33973a8-5fcf-461a-87c9-5e3cf958f15d {{(pid=94357) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Apr 21 10:42:50.061432 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.tasks.live_migrate [None req-b36673b6-0f5e-47e4-a273-1383986e1fb9 tempest-LiveAutoBlockMigrationV225Test-525213650 tempest-LiveAutoBlockMigrationV225Test-525213650-project-admin] [instance: d33973a8-5fcf-461a-87c9-5e3cf958f15d] Start binding ports on destination host: n-h1-811414-3 {{(pid=94357) _bind_ports_on_destination /opt/stack/nova/nova/conductor/tasks/live_migrate.py:389}} Apr 21 10:42:55.961691 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-bf8910ac-f926-4168-aa1c-65d78c53274e tempest-SecurityGroupsTestJSON-156794070 tempest-SecurityGroupsTestJSON-156794070-project] Took 0.53 seconds to select destinations for 1 instance(s). {{(pid=94358) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 21 10:42:56.003786 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-bf8910ac-f926-4168-aa1c-65d78c53274e tempest-SecurityGroupsTestJSON-156794070 tempest-SecurityGroupsTestJSON-156794070-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:42:56.004439 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-bf8910ac-f926-4168-aa1c-65d78c53274e tempest-SecurityGroupsTestJSON-156794070 tempest-SecurityGroupsTestJSON-156794070-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:42:56.138720 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-bf8910ac-f926-4168-aa1c-65d78c53274e tempest-SecurityGroupsTestJSON-156794070 tempest-SecurityGroupsTestJSON-156794070-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:42:56.141284 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-bf8910ac-f926-4168-aa1c-65d78c53274e tempest-SecurityGroupsTestJSON-156794070 tempest-SecurityGroupsTestJSON-156794070-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:42:56.142100 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-bf8910ac-f926-4168-aa1c-65d78c53274e tempest-SecurityGroupsTestJSON-156794070 tempest-SecurityGroupsTestJSON-156794070-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:42:56.142496 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-bf8910ac-f926-4168-aa1c-65d78c53274e tempest-SecurityGroupsTestJSON-156794070 tempest-SecurityGroupsTestJSON-156794070-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:42:56.206163 n-d-811414-3 nova-conductor[94358]: DEBUG nova.quota [None req-bf8910ac-f926-4168-aa1c-65d78c53274e tempest-SecurityGroupsTestJSON-156794070 tempest-SecurityGroupsTestJSON-156794070-project] Getting quotas for project cb090dedf4664771a67b34138b2c4ed1. Resources: {'instances', 'cores', 'ram'} {{(pid=94358) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 21 10:42:56.216069 n-d-811414-3 nova-conductor[94358]: DEBUG nova.quota [None req-bf8910ac-f926-4168-aa1c-65d78c53274e tempest-SecurityGroupsTestJSON-156794070 tempest-SecurityGroupsTestJSON-156794070-project] Getting quotas for user 44bd71d87cd54b689f3c8af3dc306101 and project cb090dedf4664771a67b34138b2c4ed1. Resources: {'instances', 'cores', 'ram'} {{(pid=94358) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 21 10:42:56.246207 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-bf8910ac-f926-4168-aa1c-65d78c53274e tempest-SecurityGroupsTestJSON-156794070 tempest-SecurityGroupsTestJSON-156794070-project] [instance: a6c80348-3288-4c0b-a7d4-b526ebd349c5] Selected host: n-h2-811414-3; Selected node: n-h2-811414-3; Alternates: [('n-h1-811414-3', 'n-h1-811414-3')] {{(pid=94358) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 21 10:42:56.247408 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-bf8910ac-f926-4168-aa1c-65d78c53274e tempest-SecurityGroupsTestJSON-156794070 tempest-SecurityGroupsTestJSON-156794070-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:42:56.247958 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-bf8910ac-f926-4168-aa1c-65d78c53274e tempest-SecurityGroupsTestJSON-156794070 tempest-SecurityGroupsTestJSON-156794070-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:42:56.267385 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-bf8910ac-f926-4168-aa1c-65d78c53274e tempest-SecurityGroupsTestJSON-156794070 tempest-SecurityGroupsTestJSON-156794070-project] [instance: a6c80348-3288-4c0b-a7d4-b526ebd349c5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f5cdc3d5-9524-4220-a7fc-ab5606975fdb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94358) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 21 10:42:56.269068 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-bf8910ac-f926-4168-aa1c-65d78c53274e tempest-SecurityGroupsTestJSON-156794070 tempest-SecurityGroupsTestJSON-156794070-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:42:56.269697 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-bf8910ac-f926-4168-aa1c-65d78c53274e tempest-SecurityGroupsTestJSON-156794070 tempest-SecurityGroupsTestJSON-156794070-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:42:56.342843 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-bf8910ac-f926-4168-aa1c-65d78c53274e tempest-SecurityGroupsTestJSON-156794070 tempest-SecurityGroupsTestJSON-156794070-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:42:56.342843 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-bf8910ac-f926-4168-aa1c-65d78c53274e tempest-SecurityGroupsTestJSON-156794070 tempest-SecurityGroupsTestJSON-156794070-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:43:06.655017 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-202355c2-d11c-45d4-972e-321537c25430 tempest-ServersTestManualDisk-1162269955 tempest-ServersTestManualDisk-1162269955-project] Took 0.59 seconds to select destinations for 1 instance(s). {{(pid=94357) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 21 10:43:06.721493 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-202355c2-d11c-45d4-972e-321537c25430 tempest-ServersTestManualDisk-1162269955 tempest-ServersTestManualDisk-1162269955-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:43:06.721902 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-202355c2-d11c-45d4-972e-321537c25430 tempest-ServersTestManualDisk-1162269955 tempest-ServersTestManualDisk-1162269955-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:43:06.910883 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-202355c2-d11c-45d4-972e-321537c25430 tempest-ServersTestManualDisk-1162269955 tempest-ServersTestManualDisk-1162269955-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:43:06.912542 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-202355c2-d11c-45d4-972e-321537c25430 tempest-ServersTestManualDisk-1162269955 tempest-ServersTestManualDisk-1162269955-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:43:06.914488 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-202355c2-d11c-45d4-972e-321537c25430 tempest-ServersTestManualDisk-1162269955 tempest-ServersTestManualDisk-1162269955-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:43:06.919615 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-202355c2-d11c-45d4-972e-321537c25430 tempest-ServersTestManualDisk-1162269955 tempest-ServersTestManualDisk-1162269955-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:43:06.957711 n-d-811414-3 nova-conductor[94357]: DEBUG nova.quota [None req-202355c2-d11c-45d4-972e-321537c25430 tempest-ServersTestManualDisk-1162269955 tempest-ServersTestManualDisk-1162269955-project] Getting quotas for project e2a6014bc73a49188b5075398c8ebe06. Resources: {'instances', 'cores', 'ram'} {{(pid=94357) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 21 10:43:06.963782 n-d-811414-3 nova-conductor[94357]: DEBUG nova.quota [None req-202355c2-d11c-45d4-972e-321537c25430 tempest-ServersTestManualDisk-1162269955 tempest-ServersTestManualDisk-1162269955-project] Getting quotas for user 1828c34eddbe48b1ab5b85db825fba87 and project e2a6014bc73a49188b5075398c8ebe06. Resources: {'instances', 'cores', 'ram'} {{(pid=94357) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 21 10:43:06.975586 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-202355c2-d11c-45d4-972e-321537c25430 tempest-ServersTestManualDisk-1162269955 tempest-ServersTestManualDisk-1162269955-project] [instance: 111ca9d4-b864-411a-a312-ecf13657fd10] Selected host: n-h1-811414-3; Selected node: n-h1-811414-3; Alternates: [('n-h2-811414-3', 'n-h2-811414-3')] {{(pid=94357) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 21 10:43:06.976926 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-202355c2-d11c-45d4-972e-321537c25430 tempest-ServersTestManualDisk-1162269955 tempest-ServersTestManualDisk-1162269955-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:43:06.977475 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-202355c2-d11c-45d4-972e-321537c25430 tempest-ServersTestManualDisk-1162269955 tempest-ServersTestManualDisk-1162269955-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:43:06.997663 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-202355c2-d11c-45d4-972e-321537c25430 tempest-ServersTestManualDisk-1162269955 tempest-ServersTestManualDisk-1162269955-project] [instance: 111ca9d4-b864-411a-a312-ecf13657fd10] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f5cdc3d5-9524-4220-a7fc-ab5606975fdb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94357) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 21 10:43:06.999592 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-202355c2-d11c-45d4-972e-321537c25430 tempest-ServersTestManualDisk-1162269955 tempest-ServersTestManualDisk-1162269955-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:43:07.000204 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-202355c2-d11c-45d4-972e-321537c25430 tempest-ServersTestManualDisk-1162269955 tempest-ServersTestManualDisk-1162269955-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:43:07.062046 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-202355c2-d11c-45d4-972e-321537c25430 tempest-ServersTestManualDisk-1162269955 tempest-ServersTestManualDisk-1162269955-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:43:07.063854 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-202355c2-d11c-45d4-972e-321537c25430 tempest-ServersTestManualDisk-1162269955 tempest-ServersTestManualDisk-1162269955-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:43:17.244867 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-3547c3ea-1465-4b21-b8ae-6eb3ee532002 tempest-MigrationsAdminTest-1313869673 tempest-MigrationsAdminTest-1313869673-project-admin] Targeting cell 6c99d8ec-fb48-48af-b02b-a629a7c2cb6b(cell1) for conductor method migrate_server {{(pid=94358) wrapper /opt/stack/nova/nova/conductor/manager.py:91}} Apr 21 10:43:17.245361 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-3547c3ea-1465-4b21-b8ae-6eb3ee532002 tempest-MigrationsAdminTest-1313869673 tempest-MigrationsAdminTest-1313869673-project-admin] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:43:17.245361 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-3547c3ea-1465-4b21-b8ae-6eb3ee532002 tempest-MigrationsAdminTest-1313869673 tempest-MigrationsAdminTest-1313869673-project-admin] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:43:17.724696 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.tasks.migrate [None req-3547c3ea-1465-4b21-b8ae-6eb3ee532002 tempest-MigrationsAdminTest-1313869673 tempest-MigrationsAdminTest-1313869673-project-admin] [instance: 9da977c1-147d-4a20-a090-9ba7e1b401c0] Restricting to cell 6c99d8ec-fb48-48af-b02b-a629a7c2cb6b(cell1) while migrating {{(pid=94358) _set_requested_destination_cell /opt/stack/nova/nova/conductor/tasks/migrate.py:208}} Apr 21 10:43:18.129048 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.tasks.migrate [None req-3547c3ea-1465-4b21-b8ae-6eb3ee532002 tempest-MigrationsAdminTest-1313869673 tempest-MigrationsAdminTest-1313869673-project-admin] Created allocations for migration 9874dc90-bcd4-4d97-bd89-08daa14c98fd on 43480f3a-fb09-463e-8326-6927c98a38b4 {{(pid=94358) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} Apr 21 10:43:18.504643 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.tasks.migrate [None req-3547c3ea-1465-4b21-b8ae-6eb3ee532002 tempest-MigrationsAdminTest-1313869673 tempest-MigrationsAdminTest-1313869673-project-admin] [instance: 9da977c1-147d-4a20-a090-9ba7e1b401c0] Calling prep_resize with selected host: n-h2-811414-3; Selected node: n-h2-811414-3; Alternates: [] {{(pid=94358) _execute /opt/stack/nova/nova/conductor/tasks/migrate.py:315}} Apr 21 10:43:23.179187 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-f878b0ed-f1e1-4a74-80ac-183177e215f1 tempest-ImagesTestJSON-2141840651 tempest-ImagesTestJSON-2141840651-project] Took 0.48 seconds to select destinations for 1 instance(s). {{(pid=94357) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 21 10:43:23.204989 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-f878b0ed-f1e1-4a74-80ac-183177e215f1 tempest-ImagesTestJSON-2141840651 tempest-ImagesTestJSON-2141840651-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:43:23.205648 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-f878b0ed-f1e1-4a74-80ac-183177e215f1 tempest-ImagesTestJSON-2141840651 tempest-ImagesTestJSON-2141840651-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:43:23.275248 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-f878b0ed-f1e1-4a74-80ac-183177e215f1 tempest-ImagesTestJSON-2141840651 tempest-ImagesTestJSON-2141840651-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:43:23.275904 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-f878b0ed-f1e1-4a74-80ac-183177e215f1 tempest-ImagesTestJSON-2141840651 tempest-ImagesTestJSON-2141840651-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:43:23.276867 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-f878b0ed-f1e1-4a74-80ac-183177e215f1 tempest-ImagesTestJSON-2141840651 tempest-ImagesTestJSON-2141840651-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:43:23.277523 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-f878b0ed-f1e1-4a74-80ac-183177e215f1 tempest-ImagesTestJSON-2141840651 tempest-ImagesTestJSON-2141840651-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:43:23.296829 n-d-811414-3 nova-conductor[94357]: DEBUG nova.quota [None req-f878b0ed-f1e1-4a74-80ac-183177e215f1 tempest-ImagesTestJSON-2141840651 tempest-ImagesTestJSON-2141840651-project] Getting quotas for project 0bba3afe8fe04b9f9288dc0d33f6719e. Resources: {'instances', 'cores', 'ram'} {{(pid=94357) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 21 10:43:23.301056 n-d-811414-3 nova-conductor[94357]: DEBUG nova.quota [None req-f878b0ed-f1e1-4a74-80ac-183177e215f1 tempest-ImagesTestJSON-2141840651 tempest-ImagesTestJSON-2141840651-project] Getting quotas for user efce50a365d3495eab4a41e5063cdfc7 and project 0bba3afe8fe04b9f9288dc0d33f6719e. Resources: {'instances', 'cores', 'ram'} {{(pid=94357) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 21 10:43:23.312695 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-f878b0ed-f1e1-4a74-80ac-183177e215f1 tempest-ImagesTestJSON-2141840651 tempest-ImagesTestJSON-2141840651-project] [instance: 5456aa52-e021-4522-8736-4d8cb0aa08e2] Selected host: n-h1-811414-3; Selected node: n-h1-811414-3; Alternates: [('n-h2-811414-3', 'n-h2-811414-3')] {{(pid=94357) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 21 10:43:23.314074 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-f878b0ed-f1e1-4a74-80ac-183177e215f1 tempest-ImagesTestJSON-2141840651 tempest-ImagesTestJSON-2141840651-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:43:23.314799 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-f878b0ed-f1e1-4a74-80ac-183177e215f1 tempest-ImagesTestJSON-2141840651 tempest-ImagesTestJSON-2141840651-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:43:23.329898 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-f878b0ed-f1e1-4a74-80ac-183177e215f1 tempest-ImagesTestJSON-2141840651 tempest-ImagesTestJSON-2141840651-project] [instance: 5456aa52-e021-4522-8736-4d8cb0aa08e2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f5cdc3d5-9524-4220-a7fc-ab5606975fdb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94357) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 21 10:43:23.335440 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-f878b0ed-f1e1-4a74-80ac-183177e215f1 tempest-ImagesTestJSON-2141840651 tempest-ImagesTestJSON-2141840651-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:43:23.335862 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-f878b0ed-f1e1-4a74-80ac-183177e215f1 tempest-ImagesTestJSON-2141840651 tempest-ImagesTestJSON-2141840651-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:43:23.382781 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-f878b0ed-f1e1-4a74-80ac-183177e215f1 tempest-ImagesTestJSON-2141840651 tempest-ImagesTestJSON-2141840651-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:43:23.383410 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-f878b0ed-f1e1-4a74-80ac-183177e215f1 tempest-ImagesTestJSON-2141840651 tempest-ImagesTestJSON-2141840651-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:43:24.945361 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-4bf1bc1d-1fd3-408d-afca-50b6c8453c2f tempest-LiveMigrationTest-1685226576 tempest-LiveMigrationTest-1685226576-project-admin] Targeting cell 6c99d8ec-fb48-48af-b02b-a629a7c2cb6b(cell1) for conductor method migrate_server {{(pid=94358) wrapper /opt/stack/nova/nova/conductor/manager.py:91}} Apr 21 10:43:24.946045 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-4bf1bc1d-1fd3-408d-afca-50b6c8453c2f tempest-LiveMigrationTest-1685226576 tempest-LiveMigrationTest-1685226576-project-admin] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:43:24.946332 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-4bf1bc1d-1fd3-408d-afca-50b6c8453c2f tempest-LiveMigrationTest-1685226576 tempest-LiveMigrationTest-1685226576-project-admin] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:43:25.490185 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.tasks.migrate [None req-4bf1bc1d-1fd3-408d-afca-50b6c8453c2f tempest-LiveMigrationTest-1685226576 tempest-LiveMigrationTest-1685226576-project-admin] Created allocations for migration 48ba029e-7c9d-4d88-b675-52b52e8997c5 on 6ea3f8b1-0c53-40ba-ba27-f80f78a284a6 {{(pid=94358) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} Apr 21 10:43:25.609171 n-d-811414-3 nova-conductor[94358]: DEBUG nova.scheduler.utils [None req-4bf1bc1d-1fd3-408d-afca-50b6c8453c2f tempest-LiveMigrationTest-1685226576 tempest-LiveMigrationTest-1685226576-project-admin] [instance: 17aa3c0a-b49e-4be7-bbc2-8a4fc618865c] Instance allocations successfully created on destination node 43480f3a-fb09-463e-8326-6927c98a38b4: {'allocations': {'43480f3a-fb09-463e-8326-6927c98a38b4': {'resources': {'VCPU': 1, 'MEMORY_MB': 1024}}}} {{(pid=94358) claim_resources_on_destination /opt/stack/nova/nova/scheduler/utils.py:827}} Apr 21 10:43:25.610079 n-d-811414-3 nova-conductor[94358]: DEBUG nova.objects.instance [None req-4bf1bc1d-1fd3-408d-afca-50b6c8453c2f tempest-LiveMigrationTest-1685226576 tempest-LiveMigrationTest-1685226576-project-admin] Lazy-loading 'resources' on Instance uuid 17aa3c0a-b49e-4be7-bbc2-8a4fc618865c {{(pid=94358) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Apr 21 10:43:25.614964 n-d-811414-3 nova-conductor[94358]: DEBUG nova.objects.instance [None req-4bf1bc1d-1fd3-408d-afca-50b6c8453c2f tempest-LiveMigrationTest-1685226576 tempest-LiveMigrationTest-1685226576-project-admin] Lazy-loading 'pci_requests' on Instance uuid 17aa3c0a-b49e-4be7-bbc2-8a4fc618865c {{(pid=94358) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Apr 21 10:43:25.996805 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.tasks.live_migrate [None req-4bf1bc1d-1fd3-408d-afca-50b6c8453c2f tempest-LiveMigrationTest-1685226576 tempest-LiveMigrationTest-1685226576-project-admin] [instance: 17aa3c0a-b49e-4be7-bbc2-8a4fc618865c] Start binding ports on destination host: n-h1-811414-3 {{(pid=94358) _bind_ports_on_destination /opt/stack/nova/nova/conductor/tasks/live_migrate.py:389}} Apr 21 10:43:40.355974 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-9a3c3639-0bad-4d8a-8809-5605dc576937 tempest-DeleteServersTestJSON-192729269 tempest-DeleteServersTestJSON-192729269-project] Took 0.30 seconds to select destinations for 1 instance(s). {{(pid=94357) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 21 10:43:40.395767 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-9a3c3639-0bad-4d8a-8809-5605dc576937 tempest-DeleteServersTestJSON-192729269 tempest-DeleteServersTestJSON-192729269-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:43:40.396407 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-9a3c3639-0bad-4d8a-8809-5605dc576937 tempest-DeleteServersTestJSON-192729269 tempest-DeleteServersTestJSON-192729269-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:43:40.497948 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-9a3c3639-0bad-4d8a-8809-5605dc576937 tempest-DeleteServersTestJSON-192729269 tempest-DeleteServersTestJSON-192729269-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:43:40.497948 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-9a3c3639-0bad-4d8a-8809-5605dc576937 tempest-DeleteServersTestJSON-192729269 tempest-DeleteServersTestJSON-192729269-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:43:40.497948 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-9a3c3639-0bad-4d8a-8809-5605dc576937 tempest-DeleteServersTestJSON-192729269 tempest-DeleteServersTestJSON-192729269-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:43:40.497948 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-9a3c3639-0bad-4d8a-8809-5605dc576937 tempest-DeleteServersTestJSON-192729269 tempest-DeleteServersTestJSON-192729269-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:43:40.516422 n-d-811414-3 nova-conductor[94357]: DEBUG nova.quota [None req-9a3c3639-0bad-4d8a-8809-5605dc576937 tempest-DeleteServersTestJSON-192729269 tempest-DeleteServersTestJSON-192729269-project] Getting quotas for project 37786f41cece448d819cedcc10899423. Resources: {'instances', 'cores', 'ram'} {{(pid=94357) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 21 10:43:40.522097 n-d-811414-3 nova-conductor[94357]: DEBUG nova.quota [None req-9a3c3639-0bad-4d8a-8809-5605dc576937 tempest-DeleteServersTestJSON-192729269 tempest-DeleteServersTestJSON-192729269-project] Getting quotas for user 37fbf69bd6394006b1977bd1d651621f and project 37786f41cece448d819cedcc10899423. Resources: {'instances', 'cores', 'ram'} {{(pid=94357) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 21 10:43:40.535474 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-9a3c3639-0bad-4d8a-8809-5605dc576937 tempest-DeleteServersTestJSON-192729269 tempest-DeleteServersTestJSON-192729269-project] [instance: ddb5b563-ac6f-4d2a-9c92-8ff334fbea5d] Selected host: n-h2-811414-3; Selected node: n-h2-811414-3; Alternates: [('n-h1-811414-3', 'n-h1-811414-3')] {{(pid=94357) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 21 10:43:40.535981 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-9a3c3639-0bad-4d8a-8809-5605dc576937 tempest-DeleteServersTestJSON-192729269 tempest-DeleteServersTestJSON-192729269-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:43:40.536507 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-9a3c3639-0bad-4d8a-8809-5605dc576937 tempest-DeleteServersTestJSON-192729269 tempest-DeleteServersTestJSON-192729269-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:43:40.545219 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-9a3c3639-0bad-4d8a-8809-5605dc576937 tempest-DeleteServersTestJSON-192729269 tempest-DeleteServersTestJSON-192729269-project] [instance: ddb5b563-ac6f-4d2a-9c92-8ff334fbea5d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f5cdc3d5-9524-4220-a7fc-ab5606975fdb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94357) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 21 10:43:40.547065 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-9a3c3639-0bad-4d8a-8809-5605dc576937 tempest-DeleteServersTestJSON-192729269 tempest-DeleteServersTestJSON-192729269-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:43:40.547515 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-9a3c3639-0bad-4d8a-8809-5605dc576937 tempest-DeleteServersTestJSON-192729269 tempest-DeleteServersTestJSON-192729269-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:43:40.600022 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-9a3c3639-0bad-4d8a-8809-5605dc576937 tempest-DeleteServersTestJSON-192729269 tempest-DeleteServersTestJSON-192729269-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:43:40.600435 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-9a3c3639-0bad-4d8a-8809-5605dc576937 tempest-DeleteServersTestJSON-192729269 tempest-DeleteServersTestJSON-192729269-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:44:08.440429 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-693609f5-96a3-475c-9c6e-0551adc57520 tempest-MigrationsAdminTest-641231928 tempest-MigrationsAdminTest-641231928-project] Took 0.37 seconds to select destinations for 1 instance(s). {{(pid=94358) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 21 10:44:08.465644 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-693609f5-96a3-475c-9c6e-0551adc57520 tempest-MigrationsAdminTest-641231928 tempest-MigrationsAdminTest-641231928-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:44:08.466391 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-693609f5-96a3-475c-9c6e-0551adc57520 tempest-MigrationsAdminTest-641231928 tempest-MigrationsAdminTest-641231928-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:44:08.519667 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-693609f5-96a3-475c-9c6e-0551adc57520 tempest-MigrationsAdminTest-641231928 tempest-MigrationsAdminTest-641231928-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:44:08.520139 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-693609f5-96a3-475c-9c6e-0551adc57520 tempest-MigrationsAdminTest-641231928 tempest-MigrationsAdminTest-641231928-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:44:08.520980 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-693609f5-96a3-475c-9c6e-0551adc57520 tempest-MigrationsAdminTest-641231928 tempest-MigrationsAdminTest-641231928-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:44:08.521589 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-693609f5-96a3-475c-9c6e-0551adc57520 tempest-MigrationsAdminTest-641231928 tempest-MigrationsAdminTest-641231928-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:44:08.541946 n-d-811414-3 nova-conductor[94358]: DEBUG nova.quota [None req-693609f5-96a3-475c-9c6e-0551adc57520 tempest-MigrationsAdminTest-641231928 tempest-MigrationsAdminTest-641231928-project] Getting quotas for project eaa9a71aac0c466dbbfc09ba3cf71440. Resources: {'instances', 'cores', 'ram'} {{(pid=94358) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 21 10:44:08.547300 n-d-811414-3 nova-conductor[94358]: DEBUG nova.quota [None req-693609f5-96a3-475c-9c6e-0551adc57520 tempest-MigrationsAdminTest-641231928 tempest-MigrationsAdminTest-641231928-project] Getting quotas for user 521d609e0c8a430fa8f33c9db9870430 and project eaa9a71aac0c466dbbfc09ba3cf71440. Resources: {'instances', 'cores', 'ram'} {{(pid=94358) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 21 10:44:08.559422 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-693609f5-96a3-475c-9c6e-0551adc57520 tempest-MigrationsAdminTest-641231928 tempest-MigrationsAdminTest-641231928-project] [instance: 60c29ad7-1563-4dfc-bb80-54879d010e7a] Selected host: n-h2-811414-3; Selected node: n-h2-811414-3; Alternates: [('n-h1-811414-3', 'n-h1-811414-3')] {{(pid=94358) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 21 10:44:08.560815 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-693609f5-96a3-475c-9c6e-0551adc57520 tempest-MigrationsAdminTest-641231928 tempest-MigrationsAdminTest-641231928-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:44:08.561590 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-693609f5-96a3-475c-9c6e-0551adc57520 tempest-MigrationsAdminTest-641231928 tempest-MigrationsAdminTest-641231928-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:44:08.572730 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-693609f5-96a3-475c-9c6e-0551adc57520 tempest-MigrationsAdminTest-641231928 tempest-MigrationsAdminTest-641231928-project] [instance: 60c29ad7-1563-4dfc-bb80-54879d010e7a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f5cdc3d5-9524-4220-a7fc-ab5606975fdb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94358) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 21 10:44:08.576066 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-693609f5-96a3-475c-9c6e-0551adc57520 tempest-MigrationsAdminTest-641231928 tempest-MigrationsAdminTest-641231928-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:44:08.577182 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-693609f5-96a3-475c-9c6e-0551adc57520 tempest-MigrationsAdminTest-641231928 tempest-MigrationsAdminTest-641231928-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:44:08.620779 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-693609f5-96a3-475c-9c6e-0551adc57520 tempest-MigrationsAdminTest-641231928 tempest-MigrationsAdminTest-641231928-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:44:08.621124 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-693609f5-96a3-475c-9c6e-0551adc57520 tempest-MigrationsAdminTest-641231928 tempest-MigrationsAdminTest-641231928-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:44:11.425663 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-ddbfa36a-df9b-4198-8353-6eac2b7128b5 tempest-LiveAutoBlockMigrationV225Test-499396072 tempest-LiveAutoBlockMigrationV225Test-499396072-project] Took 0.27 seconds to select destinations for 1 instance(s). {{(pid=94357) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 21 10:44:11.448598 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-ddbfa36a-df9b-4198-8353-6eac2b7128b5 tempest-LiveAutoBlockMigrationV225Test-499396072 tempest-LiveAutoBlockMigrationV225Test-499396072-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:44:11.449146 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-ddbfa36a-df9b-4198-8353-6eac2b7128b5 tempest-LiveAutoBlockMigrationV225Test-499396072 tempest-LiveAutoBlockMigrationV225Test-499396072-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:44:11.494386 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-ddbfa36a-df9b-4198-8353-6eac2b7128b5 tempest-LiveAutoBlockMigrationV225Test-499396072 tempest-LiveAutoBlockMigrationV225Test-499396072-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:44:11.494960 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-ddbfa36a-df9b-4198-8353-6eac2b7128b5 tempest-LiveAutoBlockMigrationV225Test-499396072 tempest-LiveAutoBlockMigrationV225Test-499396072-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:44:11.495938 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-ddbfa36a-df9b-4198-8353-6eac2b7128b5 tempest-LiveAutoBlockMigrationV225Test-499396072 tempest-LiveAutoBlockMigrationV225Test-499396072-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:44:11.496655 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-ddbfa36a-df9b-4198-8353-6eac2b7128b5 tempest-LiveAutoBlockMigrationV225Test-499396072 tempest-LiveAutoBlockMigrationV225Test-499396072-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:44:11.518171 n-d-811414-3 nova-conductor[94357]: DEBUG nova.quota [None req-ddbfa36a-df9b-4198-8353-6eac2b7128b5 tempest-LiveAutoBlockMigrationV225Test-499396072 tempest-LiveAutoBlockMigrationV225Test-499396072-project] Getting quotas for project a5d2c091696a4f63867bc69db107ba91. Resources: {'instances', 'cores', 'ram'} {{(pid=94357) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 21 10:44:11.523984 n-d-811414-3 nova-conductor[94357]: DEBUG nova.quota [None req-ddbfa36a-df9b-4198-8353-6eac2b7128b5 tempest-LiveAutoBlockMigrationV225Test-499396072 tempest-LiveAutoBlockMigrationV225Test-499396072-project] Getting quotas for user 5b64c5ff88744287b5a5cf822fbbf185 and project a5d2c091696a4f63867bc69db107ba91. Resources: {'instances', 'cores', 'ram'} {{(pid=94357) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 21 10:44:11.541385 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-ddbfa36a-df9b-4198-8353-6eac2b7128b5 tempest-LiveAutoBlockMigrationV225Test-499396072 tempest-LiveAutoBlockMigrationV225Test-499396072-project] [instance: 6b31ab8f-e4c6-4895-b7e9-e8c4ab5a7914] Selected host: n-h2-811414-3; Selected node: n-h2-811414-3; Alternates: [('n-h1-811414-3', 'n-h1-811414-3')] {{(pid=94357) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 21 10:44:11.542618 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-ddbfa36a-df9b-4198-8353-6eac2b7128b5 tempest-LiveAutoBlockMigrationV225Test-499396072 tempest-LiveAutoBlockMigrationV225Test-499396072-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:44:11.543125 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-ddbfa36a-df9b-4198-8353-6eac2b7128b5 tempest-LiveAutoBlockMigrationV225Test-499396072 tempest-LiveAutoBlockMigrationV225Test-499396072-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:44:11.553547 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-ddbfa36a-df9b-4198-8353-6eac2b7128b5 tempest-LiveAutoBlockMigrationV225Test-499396072 tempest-LiveAutoBlockMigrationV225Test-499396072-project] [instance: 6b31ab8f-e4c6-4895-b7e9-e8c4ab5a7914] block_device_mapping [BlockDeviceMapping(attachment_id=fb2a46e5-4ab2-44f1-8333-0f1901977ff3,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='1fd6d4cc-4f54-4279-a67c-4ffecafdc442',volume_size=1,volume_type=None)] {{(pid=94357) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 21 10:44:11.556315 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-ddbfa36a-df9b-4198-8353-6eac2b7128b5 tempest-LiveAutoBlockMigrationV225Test-499396072 tempest-LiveAutoBlockMigrationV225Test-499396072-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:44:11.557411 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-ddbfa36a-df9b-4198-8353-6eac2b7128b5 tempest-LiveAutoBlockMigrationV225Test-499396072 tempest-LiveAutoBlockMigrationV225Test-499396072-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:44:11.611248 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-ddbfa36a-df9b-4198-8353-6eac2b7128b5 tempest-LiveAutoBlockMigrationV225Test-499396072 tempest-LiveAutoBlockMigrationV225Test-499396072-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:44:11.611795 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-ddbfa36a-df9b-4198-8353-6eac2b7128b5 tempest-LiveAutoBlockMigrationV225Test-499396072 tempest-LiveAutoBlockMigrationV225Test-499396072-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:44:12.889957 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-f74939dd-2051-40f5-9a5b-91fc67e42be1 tempest-DeleteServersTestJSON-192729269 tempest-DeleteServersTestJSON-192729269-project] Took 0.33 seconds to select destinations for 1 instance(s). {{(pid=94358) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 21 10:44:12.939923 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-f74939dd-2051-40f5-9a5b-91fc67e42be1 tempest-DeleteServersTestJSON-192729269 tempest-DeleteServersTestJSON-192729269-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:44:12.940718 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-f74939dd-2051-40f5-9a5b-91fc67e42be1 tempest-DeleteServersTestJSON-192729269 tempest-DeleteServersTestJSON-192729269-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:44:13.039748 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-f74939dd-2051-40f5-9a5b-91fc67e42be1 tempest-DeleteServersTestJSON-192729269 tempest-DeleteServersTestJSON-192729269-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:44:13.040221 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-f74939dd-2051-40f5-9a5b-91fc67e42be1 tempest-DeleteServersTestJSON-192729269 tempest-DeleteServersTestJSON-192729269-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:44:13.047081 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-f74939dd-2051-40f5-9a5b-91fc67e42be1 tempest-DeleteServersTestJSON-192729269 tempest-DeleteServersTestJSON-192729269-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:44:13.047684 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-f74939dd-2051-40f5-9a5b-91fc67e42be1 tempest-DeleteServersTestJSON-192729269 tempest-DeleteServersTestJSON-192729269-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:44:13.090252 n-d-811414-3 nova-conductor[94358]: DEBUG nova.quota [None req-f74939dd-2051-40f5-9a5b-91fc67e42be1 tempest-DeleteServersTestJSON-192729269 tempest-DeleteServersTestJSON-192729269-project] Getting quotas for project 37786f41cece448d819cedcc10899423. Resources: {'instances', 'cores', 'ram'} {{(pid=94358) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 21 10:44:13.094982 n-d-811414-3 nova-conductor[94358]: DEBUG nova.quota [None req-f74939dd-2051-40f5-9a5b-91fc67e42be1 tempest-DeleteServersTestJSON-192729269 tempest-DeleteServersTestJSON-192729269-project] Getting quotas for user 37fbf69bd6394006b1977bd1d651621f and project 37786f41cece448d819cedcc10899423. Resources: {'instances', 'cores', 'ram'} {{(pid=94358) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 21 10:44:13.109973 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-f74939dd-2051-40f5-9a5b-91fc67e42be1 tempest-DeleteServersTestJSON-192729269 tempest-DeleteServersTestJSON-192729269-project] [instance: 45957c7d-1451-4175-90a9-143644078557] Selected host: n-h1-811414-3; Selected node: n-h1-811414-3; Alternates: [('n-h2-811414-3', 'n-h2-811414-3')] {{(pid=94358) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 21 10:44:13.111077 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-f74939dd-2051-40f5-9a5b-91fc67e42be1 tempest-DeleteServersTestJSON-192729269 tempest-DeleteServersTestJSON-192729269-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:44:13.111647 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-f74939dd-2051-40f5-9a5b-91fc67e42be1 tempest-DeleteServersTestJSON-192729269 tempest-DeleteServersTestJSON-192729269-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:44:13.120194 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-f74939dd-2051-40f5-9a5b-91fc67e42be1 tempest-DeleteServersTestJSON-192729269 tempest-DeleteServersTestJSON-192729269-project] [instance: 45957c7d-1451-4175-90a9-143644078557] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f5cdc3d5-9524-4220-a7fc-ab5606975fdb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94358) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 21 10:44:13.121943 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-f74939dd-2051-40f5-9a5b-91fc67e42be1 tempest-DeleteServersTestJSON-192729269 tempest-DeleteServersTestJSON-192729269-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:44:13.122524 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-f74939dd-2051-40f5-9a5b-91fc67e42be1 tempest-DeleteServersTestJSON-192729269 tempest-DeleteServersTestJSON-192729269-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:44:13.175111 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-f74939dd-2051-40f5-9a5b-91fc67e42be1 tempest-DeleteServersTestJSON-192729269 tempest-DeleteServersTestJSON-192729269-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:44:13.175802 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-f74939dd-2051-40f5-9a5b-91fc67e42be1 tempest-DeleteServersTestJSON-192729269 tempest-DeleteServersTestJSON-192729269-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:44:16.574825 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-eb1fbaab-54ff-4fbf-8515-0df4248a1410 tempest-SecurityGroupsTestJSON-156794070 tempest-SecurityGroupsTestJSON-156794070-project] Took 0.36 seconds to select destinations for 1 instance(s). {{(pid=94357) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 21 10:44:16.619343 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-eb1fbaab-54ff-4fbf-8515-0df4248a1410 tempest-SecurityGroupsTestJSON-156794070 tempest-SecurityGroupsTestJSON-156794070-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:44:16.620130 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-eb1fbaab-54ff-4fbf-8515-0df4248a1410 tempest-SecurityGroupsTestJSON-156794070 tempest-SecurityGroupsTestJSON-156794070-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:44:16.711398 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-eb1fbaab-54ff-4fbf-8515-0df4248a1410 tempest-SecurityGroupsTestJSON-156794070 tempest-SecurityGroupsTestJSON-156794070-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:44:16.711902 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-eb1fbaab-54ff-4fbf-8515-0df4248a1410 tempest-SecurityGroupsTestJSON-156794070 tempest-SecurityGroupsTestJSON-156794070-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:44:16.714076 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-eb1fbaab-54ff-4fbf-8515-0df4248a1410 tempest-SecurityGroupsTestJSON-156794070 tempest-SecurityGroupsTestJSON-156794070-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:44:16.714490 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-eb1fbaab-54ff-4fbf-8515-0df4248a1410 tempest-SecurityGroupsTestJSON-156794070 tempest-SecurityGroupsTestJSON-156794070-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:44:16.755580 n-d-811414-3 nova-conductor[94357]: DEBUG nova.quota [None req-eb1fbaab-54ff-4fbf-8515-0df4248a1410 tempest-SecurityGroupsTestJSON-156794070 tempest-SecurityGroupsTestJSON-156794070-project] Getting quotas for project cb090dedf4664771a67b34138b2c4ed1. Resources: {'instances', 'cores', 'ram'} {{(pid=94357) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 21 10:44:16.768489 n-d-811414-3 nova-conductor[94357]: DEBUG nova.quota [None req-eb1fbaab-54ff-4fbf-8515-0df4248a1410 tempest-SecurityGroupsTestJSON-156794070 tempest-SecurityGroupsTestJSON-156794070-project] Getting quotas for user 44bd71d87cd54b689f3c8af3dc306101 and project cb090dedf4664771a67b34138b2c4ed1. Resources: {'instances', 'cores', 'ram'} {{(pid=94357) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 21 10:44:16.797412 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-eb1fbaab-54ff-4fbf-8515-0df4248a1410 tempest-SecurityGroupsTestJSON-156794070 tempest-SecurityGroupsTestJSON-156794070-project] [instance: 7e41b894-be09-4428-8da9-99ea223521fe] Selected host: n-h2-811414-3; Selected node: n-h2-811414-3; Alternates: [('n-h1-811414-3', 'n-h1-811414-3')] {{(pid=94357) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 21 10:44:16.798364 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-eb1fbaab-54ff-4fbf-8515-0df4248a1410 tempest-SecurityGroupsTestJSON-156794070 tempest-SecurityGroupsTestJSON-156794070-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:44:16.798772 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-eb1fbaab-54ff-4fbf-8515-0df4248a1410 tempest-SecurityGroupsTestJSON-156794070 tempest-SecurityGroupsTestJSON-156794070-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:44:16.812248 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-eb1fbaab-54ff-4fbf-8515-0df4248a1410 tempest-SecurityGroupsTestJSON-156794070 tempest-SecurityGroupsTestJSON-156794070-project] [instance: 7e41b894-be09-4428-8da9-99ea223521fe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f5cdc3d5-9524-4220-a7fc-ab5606975fdb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94357) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 21 10:44:16.813561 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-eb1fbaab-54ff-4fbf-8515-0df4248a1410 tempest-SecurityGroupsTestJSON-156794070 tempest-SecurityGroupsTestJSON-156794070-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:44:16.813982 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-eb1fbaab-54ff-4fbf-8515-0df4248a1410 tempest-SecurityGroupsTestJSON-156794070 tempest-SecurityGroupsTestJSON-156794070-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:44:16.871040 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-eb1fbaab-54ff-4fbf-8515-0df4248a1410 tempest-SecurityGroupsTestJSON-156794070 tempest-SecurityGroupsTestJSON-156794070-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:44:16.871530 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-eb1fbaab-54ff-4fbf-8515-0df4248a1410 tempest-SecurityGroupsTestJSON-156794070 tempest-SecurityGroupsTestJSON-156794070-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:44:22.751056 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-34d6f1d5-ed60-49fd-ab92-c44343ad7092 tempest-ImagesTestJSON-2141840651 tempest-ImagesTestJSON-2141840651-project] Took 0.35 seconds to select destinations for 1 instance(s). {{(pid=94358) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 21 10:44:22.796956 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-34d6f1d5-ed60-49fd-ab92-c44343ad7092 tempest-ImagesTestJSON-2141840651 tempest-ImagesTestJSON-2141840651-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:44:22.797537 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-34d6f1d5-ed60-49fd-ab92-c44343ad7092 tempest-ImagesTestJSON-2141840651 tempest-ImagesTestJSON-2141840651-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:44:22.865906 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-34d6f1d5-ed60-49fd-ab92-c44343ad7092 tempest-ImagesTestJSON-2141840651 tempest-ImagesTestJSON-2141840651-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:44:22.866538 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-34d6f1d5-ed60-49fd-ab92-c44343ad7092 tempest-ImagesTestJSON-2141840651 tempest-ImagesTestJSON-2141840651-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:44:22.867427 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-34d6f1d5-ed60-49fd-ab92-c44343ad7092 tempest-ImagesTestJSON-2141840651 tempest-ImagesTestJSON-2141840651-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:44:22.868523 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-34d6f1d5-ed60-49fd-ab92-c44343ad7092 tempest-ImagesTestJSON-2141840651 tempest-ImagesTestJSON-2141840651-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:44:22.886323 n-d-811414-3 nova-conductor[94358]: DEBUG nova.quota [None req-34d6f1d5-ed60-49fd-ab92-c44343ad7092 tempest-ImagesTestJSON-2141840651 tempest-ImagesTestJSON-2141840651-project] Getting quotas for project 0bba3afe8fe04b9f9288dc0d33f6719e. Resources: {'instances', 'cores', 'ram'} {{(pid=94358) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 21 10:44:22.890923 n-d-811414-3 nova-conductor[94358]: DEBUG nova.quota [None req-34d6f1d5-ed60-49fd-ab92-c44343ad7092 tempest-ImagesTestJSON-2141840651 tempest-ImagesTestJSON-2141840651-project] Getting quotas for user efce50a365d3495eab4a41e5063cdfc7 and project 0bba3afe8fe04b9f9288dc0d33f6719e. Resources: {'instances', 'cores', 'ram'} {{(pid=94358) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 21 10:44:22.903600 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-34d6f1d5-ed60-49fd-ab92-c44343ad7092 tempest-ImagesTestJSON-2141840651 tempest-ImagesTestJSON-2141840651-project] [instance: f7391c7e-fd7d-4bc6-b74d-67dca172b996] Selected host: n-h1-811414-3; Selected node: n-h1-811414-3; Alternates: [('n-h2-811414-3', 'n-h2-811414-3')] {{(pid=94358) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 21 10:44:22.904615 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-34d6f1d5-ed60-49fd-ab92-c44343ad7092 tempest-ImagesTestJSON-2141840651 tempest-ImagesTestJSON-2141840651-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:44:22.905066 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-34d6f1d5-ed60-49fd-ab92-c44343ad7092 tempest-ImagesTestJSON-2141840651 tempest-ImagesTestJSON-2141840651-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:44:22.915087 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-34d6f1d5-ed60-49fd-ab92-c44343ad7092 tempest-ImagesTestJSON-2141840651 tempest-ImagesTestJSON-2141840651-project] [instance: f7391c7e-fd7d-4bc6-b74d-67dca172b996] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f5cdc3d5-9524-4220-a7fc-ab5606975fdb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94358) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 21 10:44:22.916831 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-34d6f1d5-ed60-49fd-ab92-c44343ad7092 tempest-ImagesTestJSON-2141840651 tempest-ImagesTestJSON-2141840651-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:44:22.917576 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-34d6f1d5-ed60-49fd-ab92-c44343ad7092 tempest-ImagesTestJSON-2141840651 tempest-ImagesTestJSON-2141840651-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:44:22.976323 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-34d6f1d5-ed60-49fd-ab92-c44343ad7092 tempest-ImagesTestJSON-2141840651 tempest-ImagesTestJSON-2141840651-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:44:22.977107 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-34d6f1d5-ed60-49fd-ab92-c44343ad7092 tempest-ImagesTestJSON-2141840651 tempest-ImagesTestJSON-2141840651-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:44:29.788802 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-b3506b78-f221-4fd3-8d08-c5ebd610060e tempest-MigrationsAdminTest-641231928 tempest-MigrationsAdminTest-641231928-project] Targeting cell 6c99d8ec-fb48-48af-b02b-a629a7c2cb6b(cell1) for conductor method migrate_server {{(pid=94357) wrapper /opt/stack/nova/nova/conductor/manager.py:91}} Apr 21 10:44:29.789350 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-b3506b78-f221-4fd3-8d08-c5ebd610060e tempest-MigrationsAdminTest-641231928 tempest-MigrationsAdminTest-641231928-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:44:29.789915 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-b3506b78-f221-4fd3-8d08-c5ebd610060e tempest-MigrationsAdminTest-641231928 tempest-MigrationsAdminTest-641231928-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:44:30.064082 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.tasks.migrate [None req-b3506b78-f221-4fd3-8d08-c5ebd610060e tempest-MigrationsAdminTest-641231928 tempest-MigrationsAdminTest-641231928-project] [instance: 60c29ad7-1563-4dfc-bb80-54879d010e7a] Restricting to cell 6c99d8ec-fb48-48af-b02b-a629a7c2cb6b(cell1) while migrating {{(pid=94357) _set_requested_destination_cell /opt/stack/nova/nova/conductor/tasks/migrate.py:208}} Apr 21 10:44:30.506610 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.tasks.migrate [None req-b3506b78-f221-4fd3-8d08-c5ebd610060e tempest-MigrationsAdminTest-641231928 tempest-MigrationsAdminTest-641231928-project] Created allocations for migration cb6c8e3d-6c06-4516-bcf0-dfc276731d7f on 6ea3f8b1-0c53-40ba-ba27-f80f78a284a6 {{(pid=94357) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} Apr 21 10:44:30.873832 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.tasks.migrate [None req-b3506b78-f221-4fd3-8d08-c5ebd610060e tempest-MigrationsAdminTest-641231928 tempest-MigrationsAdminTest-641231928-project] [instance: 60c29ad7-1563-4dfc-bb80-54879d010e7a] Calling prep_resize with selected host: n-h2-811414-3; Selected node: n-h2-811414-3; Alternates: [Selection(allocation_request='{"allocations": {"43480f3a-fb09-463e-8326-6927c98a38b4": {"resources": {"DISK_GB": 1, "MEMORY_MB": 512, "VCPU": 1}}}, "mappings": {"": ["43480f3a-fb09-463e-8326-6927c98a38b4"]}}',allocation_request_version='1.35',availability_zone='nova',cell_uuid=6c99d8ec-fb48-48af-b02b-a629a7c2cb6b,compute_node_uuid=43480f3a-fb09-463e-8326-6927c98a38b4,limits=SchedulerLimits,nodename='n-h1-811414-3',service_host='n-h1-811414-3')] {{(pid=94357) _execute /opt/stack/nova/nova/conductor/tasks/migrate.py:315}} Apr 21 10:44:38.232660 n-d-811414-3 nova-conductor[94358]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 21 10:44:43.335555 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-f568cbfd-ba8b-4614-aa30-f55bea08f26d tempest-LiveAutoBlockMigrationV225Test-525213650 tempest-LiveAutoBlockMigrationV225Test-525213650-project-admin] Targeting cell 6c99d8ec-fb48-48af-b02b-a629a7c2cb6b(cell1) for conductor method migrate_server {{(pid=94358) wrapper /opt/stack/nova/nova/conductor/manager.py:91}} Apr 21 10:44:43.336166 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-f568cbfd-ba8b-4614-aa30-f55bea08f26d tempest-LiveAutoBlockMigrationV225Test-525213650 tempest-LiveAutoBlockMigrationV225Test-525213650-project-admin] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:44:43.345442 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-f568cbfd-ba8b-4614-aa30-f55bea08f26d tempest-LiveAutoBlockMigrationV225Test-525213650 tempest-LiveAutoBlockMigrationV225Test-525213650-project-admin] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:44:43.980590 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.tasks.migrate [None req-f568cbfd-ba8b-4614-aa30-f55bea08f26d tempest-LiveAutoBlockMigrationV225Test-525213650 tempest-LiveAutoBlockMigrationV225Test-525213650-project-admin] Created allocations for migration 10a39fd6-7f0f-404e-a4a3-6e606f4eed32 on 6ea3f8b1-0c53-40ba-ba27-f80f78a284a6 {{(pid=94358) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} Apr 21 10:44:44.500738 n-d-811414-3 nova-conductor[94358]: DEBUG nova.scheduler.utils [None req-f568cbfd-ba8b-4614-aa30-f55bea08f26d tempest-LiveAutoBlockMigrationV225Test-525213650 tempest-LiveAutoBlockMigrationV225Test-525213650-project-admin] [instance: 6b31ab8f-e4c6-4895-b7e9-e8c4ab5a7914] Instance allocations successfully created on destination node 43480f3a-fb09-463e-8326-6927c98a38b4: {'allocations': {'43480f3a-fb09-463e-8326-6927c98a38b4': {'resources': {'VCPU': 1, 'MEMORY_MB': 1024}}}} {{(pid=94358) claim_resources_on_destination /opt/stack/nova/nova/scheduler/utils.py:827}} Apr 21 10:44:44.500738 n-d-811414-3 nova-conductor[94358]: DEBUG nova.objects.instance [None req-f568cbfd-ba8b-4614-aa30-f55bea08f26d tempest-LiveAutoBlockMigrationV225Test-525213650 tempest-LiveAutoBlockMigrationV225Test-525213650-project-admin] Lazy-loading 'resources' on Instance uuid 6b31ab8f-e4c6-4895-b7e9-e8c4ab5a7914 {{(pid=94358) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Apr 21 10:44:44.512991 n-d-811414-3 nova-conductor[94358]: DEBUG nova.objects.instance [None req-f568cbfd-ba8b-4614-aa30-f55bea08f26d tempest-LiveAutoBlockMigrationV225Test-525213650 tempest-LiveAutoBlockMigrationV225Test-525213650-project-admin] Lazy-loading 'pci_requests' on Instance uuid 6b31ab8f-e4c6-4895-b7e9-e8c4ab5a7914 {{(pid=94358) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Apr 21 10:44:45.562498 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.tasks.live_migrate [None req-f568cbfd-ba8b-4614-aa30-f55bea08f26d tempest-LiveAutoBlockMigrationV225Test-525213650 tempest-LiveAutoBlockMigrationV225Test-525213650-project-admin] [instance: 6b31ab8f-e4c6-4895-b7e9-e8c4ab5a7914] Start binding ports on destination host: n-h1-811414-3 {{(pid=94358) _bind_ports_on_destination /opt/stack/nova/nova/conductor/tasks/live_migrate.py:389}} Apr 21 10:44:54.251720 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-af8ef051-814e-4439-be8b-e52533ba9c5d tempest-InstanceActionsTestJSON-1065054117 tempest-InstanceActionsTestJSON-1065054117-project] Took 0.28 seconds to select destinations for 1 instance(s). {{(pid=94357) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 21 10:44:54.293164 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-af8ef051-814e-4439-be8b-e52533ba9c5d tempest-InstanceActionsTestJSON-1065054117 tempest-InstanceActionsTestJSON-1065054117-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:44:54.293670 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-af8ef051-814e-4439-be8b-e52533ba9c5d tempest-InstanceActionsTestJSON-1065054117 tempest-InstanceActionsTestJSON-1065054117-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:44:54.352314 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-af8ef051-814e-4439-be8b-e52533ba9c5d tempest-InstanceActionsTestJSON-1065054117 tempest-InstanceActionsTestJSON-1065054117-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:44:54.352856 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-af8ef051-814e-4439-be8b-e52533ba9c5d tempest-InstanceActionsTestJSON-1065054117 tempest-InstanceActionsTestJSON-1065054117-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:44:54.353561 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-af8ef051-814e-4439-be8b-e52533ba9c5d tempest-InstanceActionsTestJSON-1065054117 tempest-InstanceActionsTestJSON-1065054117-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:44:54.353998 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-af8ef051-814e-4439-be8b-e52533ba9c5d tempest-InstanceActionsTestJSON-1065054117 tempest-InstanceActionsTestJSON-1065054117-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:44:54.381786 n-d-811414-3 nova-conductor[94357]: DEBUG nova.quota [None req-af8ef051-814e-4439-be8b-e52533ba9c5d tempest-InstanceActionsTestJSON-1065054117 tempest-InstanceActionsTestJSON-1065054117-project] Getting quotas for project 26320656a469498d844a4d208fb244a8. Resources: {'instances', 'cores', 'ram'} {{(pid=94357) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 21 10:44:54.390122 n-d-811414-3 nova-conductor[94357]: DEBUG nova.quota [None req-af8ef051-814e-4439-be8b-e52533ba9c5d tempest-InstanceActionsTestJSON-1065054117 tempest-InstanceActionsTestJSON-1065054117-project] Getting quotas for user 84feb83d72f6451f947c1dfba36b6ed2 and project 26320656a469498d844a4d208fb244a8. Resources: {'instances', 'cores', 'ram'} {{(pid=94357) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 21 10:44:54.402400 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-af8ef051-814e-4439-be8b-e52533ba9c5d tempest-InstanceActionsTestJSON-1065054117 tempest-InstanceActionsTestJSON-1065054117-project] [instance: 278d9387-0eb9-48e4-a241-b23d2d0a1278] Selected host: n-h1-811414-3; Selected node: n-h1-811414-3; Alternates: [('n-h2-811414-3', 'n-h2-811414-3')] {{(pid=94357) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 21 10:44:54.403365 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-af8ef051-814e-4439-be8b-e52533ba9c5d tempest-InstanceActionsTestJSON-1065054117 tempest-InstanceActionsTestJSON-1065054117-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:44:54.403804 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-af8ef051-814e-4439-be8b-e52533ba9c5d tempest-InstanceActionsTestJSON-1065054117 tempest-InstanceActionsTestJSON-1065054117-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:44:54.413928 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-af8ef051-814e-4439-be8b-e52533ba9c5d tempest-InstanceActionsTestJSON-1065054117 tempest-InstanceActionsTestJSON-1065054117-project] [instance: 278d9387-0eb9-48e4-a241-b23d2d0a1278] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f5cdc3d5-9524-4220-a7fc-ab5606975fdb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94357) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 21 10:44:54.416157 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-af8ef051-814e-4439-be8b-e52533ba9c5d tempest-InstanceActionsTestJSON-1065054117 tempest-InstanceActionsTestJSON-1065054117-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:44:54.417361 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-af8ef051-814e-4439-be8b-e52533ba9c5d tempest-InstanceActionsTestJSON-1065054117 tempest-InstanceActionsTestJSON-1065054117-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:44:54.480226 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-af8ef051-814e-4439-be8b-e52533ba9c5d tempest-InstanceActionsTestJSON-1065054117 tempest-InstanceActionsTestJSON-1065054117-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:44:54.480226 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-af8ef051-814e-4439-be8b-e52533ba9c5d tempest-InstanceActionsTestJSON-1065054117 tempest-InstanceActionsTestJSON-1065054117-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:44:58.400761 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-3f8a1518-cc59-43b1-98a7-d537f95988e7 tempest-DeleteServersTestJSON-192729269 tempest-DeleteServersTestJSON-192729269-project] Took 0.52 seconds to select destinations for 1 instance(s). {{(pid=94358) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 21 10:44:58.444327 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-3f8a1518-cc59-43b1-98a7-d537f95988e7 tempest-DeleteServersTestJSON-192729269 tempest-DeleteServersTestJSON-192729269-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:44:58.446844 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-3f8a1518-cc59-43b1-98a7-d537f95988e7 tempest-DeleteServersTestJSON-192729269 tempest-DeleteServersTestJSON-192729269-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:44:58.535103 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-3f8a1518-cc59-43b1-98a7-d537f95988e7 tempest-DeleteServersTestJSON-192729269 tempest-DeleteServersTestJSON-192729269-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:44:58.535970 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-3f8a1518-cc59-43b1-98a7-d537f95988e7 tempest-DeleteServersTestJSON-192729269 tempest-DeleteServersTestJSON-192729269-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:44:58.536361 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-3f8a1518-cc59-43b1-98a7-d537f95988e7 tempest-DeleteServersTestJSON-192729269 tempest-DeleteServersTestJSON-192729269-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:44:58.536801 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-3f8a1518-cc59-43b1-98a7-d537f95988e7 tempest-DeleteServersTestJSON-192729269 tempest-DeleteServersTestJSON-192729269-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:44:58.554645 n-d-811414-3 nova-conductor[94358]: DEBUG nova.quota [None req-3f8a1518-cc59-43b1-98a7-d537f95988e7 tempest-DeleteServersTestJSON-192729269 tempest-DeleteServersTestJSON-192729269-project] Getting quotas for project 37786f41cece448d819cedcc10899423. Resources: {'instances', 'cores', 'ram'} {{(pid=94358) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 21 10:44:58.559251 n-d-811414-3 nova-conductor[94358]: DEBUG nova.quota [None req-3f8a1518-cc59-43b1-98a7-d537f95988e7 tempest-DeleteServersTestJSON-192729269 tempest-DeleteServersTestJSON-192729269-project] Getting quotas for user 37fbf69bd6394006b1977bd1d651621f and project 37786f41cece448d819cedcc10899423. Resources: {'instances', 'cores', 'ram'} {{(pid=94358) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 21 10:44:58.570185 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-3f8a1518-cc59-43b1-98a7-d537f95988e7 tempest-DeleteServersTestJSON-192729269 tempest-DeleteServersTestJSON-192729269-project] [instance: 23e0a230-9dda-460c-ba00-a3c06d2d19ce] Selected host: n-h1-811414-3; Selected node: n-h1-811414-3; Alternates: [('n-h2-811414-3', 'n-h2-811414-3')] {{(pid=94358) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 21 10:44:58.572453 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-3f8a1518-cc59-43b1-98a7-d537f95988e7 tempest-DeleteServersTestJSON-192729269 tempest-DeleteServersTestJSON-192729269-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:44:58.572453 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-3f8a1518-cc59-43b1-98a7-d537f95988e7 tempest-DeleteServersTestJSON-192729269 tempest-DeleteServersTestJSON-192729269-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:44:58.581680 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-3f8a1518-cc59-43b1-98a7-d537f95988e7 tempest-DeleteServersTestJSON-192729269 tempest-DeleteServersTestJSON-192729269-project] [instance: 23e0a230-9dda-460c-ba00-a3c06d2d19ce] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f5cdc3d5-9524-4220-a7fc-ab5606975fdb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94358) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 21 10:44:58.586368 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-3f8a1518-cc59-43b1-98a7-d537f95988e7 tempest-DeleteServersTestJSON-192729269 tempest-DeleteServersTestJSON-192729269-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:44:58.586967 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-3f8a1518-cc59-43b1-98a7-d537f95988e7 tempest-DeleteServersTestJSON-192729269 tempest-DeleteServersTestJSON-192729269-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:44:58.640943 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-3f8a1518-cc59-43b1-98a7-d537f95988e7 tempest-DeleteServersTestJSON-192729269 tempest-DeleteServersTestJSON-192729269-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:44:58.642048 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-3f8a1518-cc59-43b1-98a7-d537f95988e7 tempest-DeleteServersTestJSON-192729269 tempest-DeleteServersTestJSON-192729269-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:45:10.935324 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-c754c0ee-80ba-4524-ae0e-fab8456e99bf tempest-ImagesNegativeTestJSON-717751353 tempest-ImagesNegativeTestJSON-717751353-project] Took 0.39 seconds to select destinations for 1 instance(s). {{(pid=94357) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 21 10:45:10.978840 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-c754c0ee-80ba-4524-ae0e-fab8456e99bf tempest-ImagesNegativeTestJSON-717751353 tempest-ImagesNegativeTestJSON-717751353-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:45:10.979518 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-c754c0ee-80ba-4524-ae0e-fab8456e99bf tempest-ImagesNegativeTestJSON-717751353 tempest-ImagesNegativeTestJSON-717751353-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:45:11.044327 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-c754c0ee-80ba-4524-ae0e-fab8456e99bf tempest-ImagesNegativeTestJSON-717751353 tempest-ImagesNegativeTestJSON-717751353-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:45:11.044980 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-c754c0ee-80ba-4524-ae0e-fab8456e99bf tempest-ImagesNegativeTestJSON-717751353 tempest-ImagesNegativeTestJSON-717751353-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:45:11.045913 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-c754c0ee-80ba-4524-ae0e-fab8456e99bf tempest-ImagesNegativeTestJSON-717751353 tempest-ImagesNegativeTestJSON-717751353-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:45:11.046723 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-c754c0ee-80ba-4524-ae0e-fab8456e99bf tempest-ImagesNegativeTestJSON-717751353 tempest-ImagesNegativeTestJSON-717751353-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:45:11.073696 n-d-811414-3 nova-conductor[94357]: DEBUG nova.quota [None req-c754c0ee-80ba-4524-ae0e-fab8456e99bf tempest-ImagesNegativeTestJSON-717751353 tempest-ImagesNegativeTestJSON-717751353-project] Getting quotas for project 76bcc400411e436fa3a2ec6dee105334. Resources: {'instances', 'cores', 'ram'} {{(pid=94357) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 21 10:45:11.078282 n-d-811414-3 nova-conductor[94357]: DEBUG nova.quota [None req-c754c0ee-80ba-4524-ae0e-fab8456e99bf tempest-ImagesNegativeTestJSON-717751353 tempest-ImagesNegativeTestJSON-717751353-project] Getting quotas for user 8e0b6f3d3aba4de69ea88d9e05160e0b and project 76bcc400411e436fa3a2ec6dee105334. Resources: {'instances', 'cores', 'ram'} {{(pid=94357) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 21 10:45:11.089550 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-c754c0ee-80ba-4524-ae0e-fab8456e99bf tempest-ImagesNegativeTestJSON-717751353 tempest-ImagesNegativeTestJSON-717751353-project] [instance: 884e7872-5041-4cc0-ba93-d3f4aa18d3b3] Selected host: n-h2-811414-3; Selected node: n-h2-811414-3; Alternates: [('n-h1-811414-3', 'n-h1-811414-3')] {{(pid=94357) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 21 10:45:11.090308 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-c754c0ee-80ba-4524-ae0e-fab8456e99bf tempest-ImagesNegativeTestJSON-717751353 tempest-ImagesNegativeTestJSON-717751353-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:45:11.090713 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-c754c0ee-80ba-4524-ae0e-fab8456e99bf tempest-ImagesNegativeTestJSON-717751353 tempest-ImagesNegativeTestJSON-717751353-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:45:11.101976 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-c754c0ee-80ba-4524-ae0e-fab8456e99bf tempest-ImagesNegativeTestJSON-717751353 tempest-ImagesNegativeTestJSON-717751353-project] [instance: 884e7872-5041-4cc0-ba93-d3f4aa18d3b3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f5cdc3d5-9524-4220-a7fc-ab5606975fdb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94357) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 21 10:45:11.103685 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-c754c0ee-80ba-4524-ae0e-fab8456e99bf tempest-ImagesNegativeTestJSON-717751353 tempest-ImagesNegativeTestJSON-717751353-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:45:11.104096 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-c754c0ee-80ba-4524-ae0e-fab8456e99bf tempest-ImagesNegativeTestJSON-717751353 tempest-ImagesNegativeTestJSON-717751353-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:45:11.131459 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-c754c0ee-80ba-4524-ae0e-fab8456e99bf tempest-ImagesNegativeTestJSON-717751353 tempest-ImagesNegativeTestJSON-717751353-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:45:11.131931 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-c754c0ee-80ba-4524-ae0e-fab8456e99bf tempest-ImagesNegativeTestJSON-717751353 tempest-ImagesNegativeTestJSON-717751353-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:45:14.841837 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-cfd9511d-8e2d-44ba-84c5-7c6c2c725bca tempest-MigrationsAdminTest-641231928 tempest-MigrationsAdminTest-641231928-project] Took 0.29 seconds to select destinations for 1 instance(s). {{(pid=94358) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 21 10:45:14.872836 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-cfd9511d-8e2d-44ba-84c5-7c6c2c725bca tempest-MigrationsAdminTest-641231928 tempest-MigrationsAdminTest-641231928-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:45:14.873501 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-cfd9511d-8e2d-44ba-84c5-7c6c2c725bca tempest-MigrationsAdminTest-641231928 tempest-MigrationsAdminTest-641231928-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:45:14.930193 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-cfd9511d-8e2d-44ba-84c5-7c6c2c725bca tempest-MigrationsAdminTest-641231928 tempest-MigrationsAdminTest-641231928-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:45:14.930895 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-cfd9511d-8e2d-44ba-84c5-7c6c2c725bca tempest-MigrationsAdminTest-641231928 tempest-MigrationsAdminTest-641231928-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:45:14.931980 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-cfd9511d-8e2d-44ba-84c5-7c6c2c725bca tempest-MigrationsAdminTest-641231928 tempest-MigrationsAdminTest-641231928-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:45:14.932574 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-cfd9511d-8e2d-44ba-84c5-7c6c2c725bca tempest-MigrationsAdminTest-641231928 tempest-MigrationsAdminTest-641231928-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:45:14.983109 n-d-811414-3 nova-conductor[94358]: DEBUG nova.quota [None req-cfd9511d-8e2d-44ba-84c5-7c6c2c725bca tempest-MigrationsAdminTest-641231928 tempest-MigrationsAdminTest-641231928-project] Getting quotas for project eaa9a71aac0c466dbbfc09ba3cf71440. Resources: {'instances', 'cores', 'ram'} {{(pid=94358) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 21 10:45:14.992140 n-d-811414-3 nova-conductor[94358]: DEBUG nova.quota [None req-cfd9511d-8e2d-44ba-84c5-7c6c2c725bca tempest-MigrationsAdminTest-641231928 tempest-MigrationsAdminTest-641231928-project] Getting quotas for user 521d609e0c8a430fa8f33c9db9870430 and project eaa9a71aac0c466dbbfc09ba3cf71440. Resources: {'instances', 'cores', 'ram'} {{(pid=94358) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 21 10:45:15.017863 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-cfd9511d-8e2d-44ba-84c5-7c6c2c725bca tempest-MigrationsAdminTest-641231928 tempest-MigrationsAdminTest-641231928-project] [instance: e60a9688-70a6-4ef8-a58f-e822a3edd778] Selected host: n-h2-811414-3; Selected node: n-h2-811414-3; Alternates: [('n-h1-811414-3', 'n-h1-811414-3')] {{(pid=94358) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 21 10:45:15.018843 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-cfd9511d-8e2d-44ba-84c5-7c6c2c725bca tempest-MigrationsAdminTest-641231928 tempest-MigrationsAdminTest-641231928-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:45:15.019248 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-cfd9511d-8e2d-44ba-84c5-7c6c2c725bca tempest-MigrationsAdminTest-641231928 tempest-MigrationsAdminTest-641231928-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:45:15.030768 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-cfd9511d-8e2d-44ba-84c5-7c6c2c725bca tempest-MigrationsAdminTest-641231928 tempest-MigrationsAdminTest-641231928-project] [instance: e60a9688-70a6-4ef8-a58f-e822a3edd778] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f5cdc3d5-9524-4220-a7fc-ab5606975fdb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94358) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 21 10:45:15.033167 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-cfd9511d-8e2d-44ba-84c5-7c6c2c725bca tempest-MigrationsAdminTest-641231928 tempest-MigrationsAdminTest-641231928-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:45:15.033572 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-cfd9511d-8e2d-44ba-84c5-7c6c2c725bca tempest-MigrationsAdminTest-641231928 tempest-MigrationsAdminTest-641231928-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:45:15.095368 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-cfd9511d-8e2d-44ba-84c5-7c6c2c725bca tempest-MigrationsAdminTest-641231928 tempest-MigrationsAdminTest-641231928-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:45:15.095979 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-cfd9511d-8e2d-44ba-84c5-7c6c2c725bca tempest-MigrationsAdminTest-641231928 tempest-MigrationsAdminTest-641231928-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:45:25.329503 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-a586c209-9654-47f9-aabd-c8338d022f06 tempest-DeleteServersTestJSON-192729269 tempest-DeleteServersTestJSON-192729269-project] Took 0.51 seconds to select destinations for 1 instance(s). {{(pid=94357) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 21 10:45:25.373618 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-a586c209-9654-47f9-aabd-c8338d022f06 tempest-DeleteServersTestJSON-192729269 tempest-DeleteServersTestJSON-192729269-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:45:25.374418 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-a586c209-9654-47f9-aabd-c8338d022f06 tempest-DeleteServersTestJSON-192729269 tempest-DeleteServersTestJSON-192729269-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:45:25.489834 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-a586c209-9654-47f9-aabd-c8338d022f06 tempest-DeleteServersTestJSON-192729269 tempest-DeleteServersTestJSON-192729269-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:45:25.490580 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-a586c209-9654-47f9-aabd-c8338d022f06 tempest-DeleteServersTestJSON-192729269 tempest-DeleteServersTestJSON-192729269-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:45:25.494420 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-a586c209-9654-47f9-aabd-c8338d022f06 tempest-DeleteServersTestJSON-192729269 tempest-DeleteServersTestJSON-192729269-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:45:25.494831 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-a586c209-9654-47f9-aabd-c8338d022f06 tempest-DeleteServersTestJSON-192729269 tempest-DeleteServersTestJSON-192729269-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:45:25.542047 n-d-811414-3 nova-conductor[94357]: DEBUG nova.quota [None req-a586c209-9654-47f9-aabd-c8338d022f06 tempest-DeleteServersTestJSON-192729269 tempest-DeleteServersTestJSON-192729269-project] Getting quotas for project 37786f41cece448d819cedcc10899423. Resources: {'instances', 'cores', 'ram'} {{(pid=94357) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 21 10:45:25.551772 n-d-811414-3 nova-conductor[94357]: DEBUG nova.quota [None req-a586c209-9654-47f9-aabd-c8338d022f06 tempest-DeleteServersTestJSON-192729269 tempest-DeleteServersTestJSON-192729269-project] Getting quotas for user 37fbf69bd6394006b1977bd1d651621f and project 37786f41cece448d819cedcc10899423. Resources: {'instances', 'cores', 'ram'} {{(pid=94357) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 21 10:45:25.574505 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-a586c209-9654-47f9-aabd-c8338d022f06 tempest-DeleteServersTestJSON-192729269 tempest-DeleteServersTestJSON-192729269-project] [instance: 87bd2790-cc23-4c6c-8aa3-ab561b8cfbbe] Selected host: n-h2-811414-3; Selected node: n-h2-811414-3; Alternates: [('n-h1-811414-3', 'n-h1-811414-3')] {{(pid=94357) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 21 10:45:25.576615 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-a586c209-9654-47f9-aabd-c8338d022f06 tempest-DeleteServersTestJSON-192729269 tempest-DeleteServersTestJSON-192729269-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:45:25.579539 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-a586c209-9654-47f9-aabd-c8338d022f06 tempest-DeleteServersTestJSON-192729269 tempest-DeleteServersTestJSON-192729269-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:45:25.603758 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-a586c209-9654-47f9-aabd-c8338d022f06 tempest-DeleteServersTestJSON-192729269 tempest-DeleteServersTestJSON-192729269-project] [instance: 87bd2790-cc23-4c6c-8aa3-ab561b8cfbbe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f5cdc3d5-9524-4220-a7fc-ab5606975fdb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94357) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 21 10:45:25.605440 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-a586c209-9654-47f9-aabd-c8338d022f06 tempest-DeleteServersTestJSON-192729269 tempest-DeleteServersTestJSON-192729269-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:45:25.617106 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-a586c209-9654-47f9-aabd-c8338d022f06 tempest-DeleteServersTestJSON-192729269 tempest-DeleteServersTestJSON-192729269-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:45:25.690010 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-a586c209-9654-47f9-aabd-c8338d022f06 tempest-DeleteServersTestJSON-192729269 tempest-DeleteServersTestJSON-192729269-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:45:25.690423 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-a586c209-9654-47f9-aabd-c8338d022f06 tempest-DeleteServersTestJSON-192729269 tempest-DeleteServersTestJSON-192729269-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:45:27.187604 n-d-811414-3 nova-conductor[94357]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6404cb3a-bdc9-481c-93a6-d63501b53d9b] AMQP server on 10.222.0.13:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 21 10:45:28.197442 n-d-811414-3 nova-conductor[94357]: INFO oslo.messaging._drivers.impl_rabbit [-] [6404cb3a-bdc9-481c-93a6-d63501b53d9b] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 44470. Apr 21 10:45:38.705897 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-25d0c8e6-f178-4210-b87c-80eb8bff158b tempest-MigrationsAdminTest-641231928 tempest-MigrationsAdminTest-641231928-project] Targeting cell 6c99d8ec-fb48-48af-b02b-a629a7c2cb6b(cell1) for conductor method migrate_server {{(pid=94358) wrapper /opt/stack/nova/nova/conductor/manager.py:91}} Apr 21 10:45:38.706580 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-25d0c8e6-f178-4210-b87c-80eb8bff158b tempest-MigrationsAdminTest-641231928 tempest-MigrationsAdminTest-641231928-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:45:38.706828 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-25d0c8e6-f178-4210-b87c-80eb8bff158b tempest-MigrationsAdminTest-641231928 tempest-MigrationsAdminTest-641231928-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:45:38.981949 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.tasks.migrate [None req-25d0c8e6-f178-4210-b87c-80eb8bff158b tempest-MigrationsAdminTest-641231928 tempest-MigrationsAdminTest-641231928-project] [instance: e60a9688-70a6-4ef8-a58f-e822a3edd778] Restricting to cell 6c99d8ec-fb48-48af-b02b-a629a7c2cb6b(cell1) while migrating {{(pid=94358) _set_requested_destination_cell /opt/stack/nova/nova/conductor/tasks/migrate.py:208}} Apr 21 10:45:39.333047 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-b403fe17-bb45-4e27-a6ec-0fb29cde1269 tempest-InstanceActionsV221TestJSON-326855420 tempest-InstanceActionsV221TestJSON-326855420-project] Took 0.57 seconds to select destinations for 1 instance(s). {{(pid=94357) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 21 10:45:39.400213 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-b403fe17-bb45-4e27-a6ec-0fb29cde1269 tempest-InstanceActionsV221TestJSON-326855420 tempest-InstanceActionsV221TestJSON-326855420-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:45:39.401301 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-b403fe17-bb45-4e27-a6ec-0fb29cde1269 tempest-InstanceActionsV221TestJSON-326855420 tempest-InstanceActionsV221TestJSON-326855420-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:45:39.494142 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-b403fe17-bb45-4e27-a6ec-0fb29cde1269 tempest-InstanceActionsV221TestJSON-326855420 tempest-InstanceActionsV221TestJSON-326855420-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:45:39.495778 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-b403fe17-bb45-4e27-a6ec-0fb29cde1269 tempest-InstanceActionsV221TestJSON-326855420 tempest-InstanceActionsV221TestJSON-326855420-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:45:39.497350 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-b403fe17-bb45-4e27-a6ec-0fb29cde1269 tempest-InstanceActionsV221TestJSON-326855420 tempest-InstanceActionsV221TestJSON-326855420-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:45:39.497936 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-b403fe17-bb45-4e27-a6ec-0fb29cde1269 tempest-InstanceActionsV221TestJSON-326855420 tempest-InstanceActionsV221TestJSON-326855420-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:45:39.523789 n-d-811414-3 nova-conductor[94357]: DEBUG nova.quota [None req-b403fe17-bb45-4e27-a6ec-0fb29cde1269 tempest-InstanceActionsV221TestJSON-326855420 tempest-InstanceActionsV221TestJSON-326855420-project] Getting quotas for project 8f807db29124433199070dbbd54a8612. Resources: {'instances', 'cores', 'ram'} {{(pid=94357) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 21 10:45:39.530203 n-d-811414-3 nova-conductor[94357]: DEBUG nova.quota [None req-b403fe17-bb45-4e27-a6ec-0fb29cde1269 tempest-InstanceActionsV221TestJSON-326855420 tempest-InstanceActionsV221TestJSON-326855420-project] Getting quotas for user bcda3dd2084948989f015595411bfceb and project 8f807db29124433199070dbbd54a8612. Resources: {'instances', 'cores', 'ram'} {{(pid=94357) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 21 10:45:39.560696 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-b403fe17-bb45-4e27-a6ec-0fb29cde1269 tempest-InstanceActionsV221TestJSON-326855420 tempest-InstanceActionsV221TestJSON-326855420-project] [instance: bd5d7be1-3adf-478a-aaa8-6f4dbc793eee] Selected host: n-h2-811414-3; Selected node: n-h2-811414-3; Alternates: [('n-h1-811414-3', 'n-h1-811414-3')] {{(pid=94357) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 21 10:45:39.565240 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-b403fe17-bb45-4e27-a6ec-0fb29cde1269 tempest-InstanceActionsV221TestJSON-326855420 tempest-InstanceActionsV221TestJSON-326855420-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:45:39.582583 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-b403fe17-bb45-4e27-a6ec-0fb29cde1269 tempest-InstanceActionsV221TestJSON-326855420 tempest-InstanceActionsV221TestJSON-326855420-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:45:39.601712 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-b403fe17-bb45-4e27-a6ec-0fb29cde1269 tempest-InstanceActionsV221TestJSON-326855420 tempest-InstanceActionsV221TestJSON-326855420-project] [instance: bd5d7be1-3adf-478a-aaa8-6f4dbc793eee] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f5cdc3d5-9524-4220-a7fc-ab5606975fdb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94357) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 21 10:45:39.603660 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-b403fe17-bb45-4e27-a6ec-0fb29cde1269 tempest-InstanceActionsV221TestJSON-326855420 tempest-InstanceActionsV221TestJSON-326855420-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:45:39.604270 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-b403fe17-bb45-4e27-a6ec-0fb29cde1269 tempest-InstanceActionsV221TestJSON-326855420 tempest-InstanceActionsV221TestJSON-326855420-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:45:39.660536 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.tasks.migrate [None req-25d0c8e6-f178-4210-b87c-80eb8bff158b tempest-MigrationsAdminTest-641231928 tempest-MigrationsAdminTest-641231928-project] Created allocations for migration 780af531-46a4-40b4-bb12-906aaae2f3c4 on 6ea3f8b1-0c53-40ba-ba27-f80f78a284a6 {{(pid=94358) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} Apr 21 10:45:39.682908 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-b403fe17-bb45-4e27-a6ec-0fb29cde1269 tempest-InstanceActionsV221TestJSON-326855420 tempest-InstanceActionsV221TestJSON-326855420-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:45:39.683357 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-b403fe17-bb45-4e27-a6ec-0fb29cde1269 tempest-InstanceActionsV221TestJSON-326855420 tempest-InstanceActionsV221TestJSON-326855420-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:45:40.127509 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.tasks.migrate [None req-25d0c8e6-f178-4210-b87c-80eb8bff158b tempest-MigrationsAdminTest-641231928 tempest-MigrationsAdminTest-641231928-project] [instance: e60a9688-70a6-4ef8-a58f-e822a3edd778] Calling prep_resize with selected host: n-h2-811414-3; Selected node: n-h2-811414-3; Alternates: [Selection(allocation_request='{"allocations": {"43480f3a-fb09-463e-8326-6927c98a38b4": {"resources": {"DISK_GB": 1, "MEMORY_MB": 512, "VCPU": 1}}}, "mappings": {"": ["43480f3a-fb09-463e-8326-6927c98a38b4"]}}',allocation_request_version='1.35',availability_zone='nova',cell_uuid=6c99d8ec-fb48-48af-b02b-a629a7c2cb6b,compute_node_uuid=43480f3a-fb09-463e-8326-6927c98a38b4,limits=SchedulerLimits,nodename='n-h1-811414-3',service_host='n-h1-811414-3')] {{(pid=94358) _execute /opt/stack/nova/nova/conductor/tasks/migrate.py:315}} Apr 21 10:45:52.231501 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-a1e1853e-460f-4856-84ba-137fe035c193 tempest-ImagesTestJSON-2141840651 tempest-ImagesTestJSON-2141840651-project] Took 0.35 seconds to select destinations for 1 instance(s). {{(pid=94358) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 21 10:45:52.274213 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-a1e1853e-460f-4856-84ba-137fe035c193 tempest-ImagesTestJSON-2141840651 tempest-ImagesTestJSON-2141840651-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:45:52.275019 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-a1e1853e-460f-4856-84ba-137fe035c193 tempest-ImagesTestJSON-2141840651 tempest-ImagesTestJSON-2141840651-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:45:52.345258 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-a1e1853e-460f-4856-84ba-137fe035c193 tempest-ImagesTestJSON-2141840651 tempest-ImagesTestJSON-2141840651-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:45:52.346267 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-a1e1853e-460f-4856-84ba-137fe035c193 tempest-ImagesTestJSON-2141840651 tempest-ImagesTestJSON-2141840651-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:45:52.347283 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-a1e1853e-460f-4856-84ba-137fe035c193 tempest-ImagesTestJSON-2141840651 tempest-ImagesTestJSON-2141840651-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:45:52.347749 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-a1e1853e-460f-4856-84ba-137fe035c193 tempest-ImagesTestJSON-2141840651 tempest-ImagesTestJSON-2141840651-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:45:52.370964 n-d-811414-3 nova-conductor[94358]: DEBUG nova.quota [None req-a1e1853e-460f-4856-84ba-137fe035c193 tempest-ImagesTestJSON-2141840651 tempest-ImagesTestJSON-2141840651-project] Getting quotas for project 0bba3afe8fe04b9f9288dc0d33f6719e. Resources: {'instances', 'cores', 'ram'} {{(pid=94358) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 21 10:45:52.376594 n-d-811414-3 nova-conductor[94358]: DEBUG nova.quota [None req-a1e1853e-460f-4856-84ba-137fe035c193 tempest-ImagesTestJSON-2141840651 tempest-ImagesTestJSON-2141840651-project] Getting quotas for user efce50a365d3495eab4a41e5063cdfc7 and project 0bba3afe8fe04b9f9288dc0d33f6719e. Resources: {'instances', 'cores', 'ram'} {{(pid=94358) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 21 10:45:52.390202 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-a1e1853e-460f-4856-84ba-137fe035c193 tempest-ImagesTestJSON-2141840651 tempest-ImagesTestJSON-2141840651-project] [instance: ee8ae38f-101b-42c8-b01d-130ed516cf77] Selected host: n-h2-811414-3; Selected node: n-h2-811414-3; Alternates: [('n-h1-811414-3', 'n-h1-811414-3')] {{(pid=94358) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 21 10:45:52.391446 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-a1e1853e-460f-4856-84ba-137fe035c193 tempest-ImagesTestJSON-2141840651 tempest-ImagesTestJSON-2141840651-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:45:52.392110 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-a1e1853e-460f-4856-84ba-137fe035c193 tempest-ImagesTestJSON-2141840651 tempest-ImagesTestJSON-2141840651-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:45:52.416829 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-a1e1853e-460f-4856-84ba-137fe035c193 tempest-ImagesTestJSON-2141840651 tempest-ImagesTestJSON-2141840651-project] [instance: ee8ae38f-101b-42c8-b01d-130ed516cf77] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f5cdc3d5-9524-4220-a7fc-ab5606975fdb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94358) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 21 10:45:52.418083 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-a1e1853e-460f-4856-84ba-137fe035c193 tempest-ImagesTestJSON-2141840651 tempest-ImagesTestJSON-2141840651-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:45:52.418659 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-a1e1853e-460f-4856-84ba-137fe035c193 tempest-ImagesTestJSON-2141840651 tempest-ImagesTestJSON-2141840651-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:45:52.487253 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-a1e1853e-460f-4856-84ba-137fe035c193 tempest-ImagesTestJSON-2141840651 tempest-ImagesTestJSON-2141840651-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:45:52.487901 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-a1e1853e-460f-4856-84ba-137fe035c193 tempest-ImagesTestJSON-2141840651 tempest-ImagesTestJSON-2141840651-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:46:01.251827 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-860c2b0b-587c-4c6e-b77d-50fdc47d1f09 tempest-DeleteServersTestJSON-192729269 tempest-DeleteServersTestJSON-192729269-project] Took 0.34 seconds to select destinations for 1 instance(s). {{(pid=94357) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 21 10:46:01.293335 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-860c2b0b-587c-4c6e-b77d-50fdc47d1f09 tempest-DeleteServersTestJSON-192729269 tempest-DeleteServersTestJSON-192729269-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:46:01.294183 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-860c2b0b-587c-4c6e-b77d-50fdc47d1f09 tempest-DeleteServersTestJSON-192729269 tempest-DeleteServersTestJSON-192729269-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:46:01.354950 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-860c2b0b-587c-4c6e-b77d-50fdc47d1f09 tempest-DeleteServersTestJSON-192729269 tempest-DeleteServersTestJSON-192729269-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:46:01.356073 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-860c2b0b-587c-4c6e-b77d-50fdc47d1f09 tempest-DeleteServersTestJSON-192729269 tempest-DeleteServersTestJSON-192729269-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:46:01.357954 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-860c2b0b-587c-4c6e-b77d-50fdc47d1f09 tempest-DeleteServersTestJSON-192729269 tempest-DeleteServersTestJSON-192729269-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:46:01.359256 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-860c2b0b-587c-4c6e-b77d-50fdc47d1f09 tempest-DeleteServersTestJSON-192729269 tempest-DeleteServersTestJSON-192729269-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:46:01.405374 n-d-811414-3 nova-conductor[94357]: DEBUG nova.quota [None req-860c2b0b-587c-4c6e-b77d-50fdc47d1f09 tempest-DeleteServersTestJSON-192729269 tempest-DeleteServersTestJSON-192729269-project] Getting quotas for project 37786f41cece448d819cedcc10899423. Resources: {'instances', 'cores', 'ram'} {{(pid=94357) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 21 10:46:01.410725 n-d-811414-3 nova-conductor[94357]: DEBUG nova.quota [None req-860c2b0b-587c-4c6e-b77d-50fdc47d1f09 tempest-DeleteServersTestJSON-192729269 tempest-DeleteServersTestJSON-192729269-project] Getting quotas for user 37fbf69bd6394006b1977bd1d651621f and project 37786f41cece448d819cedcc10899423. Resources: {'instances', 'cores', 'ram'} {{(pid=94357) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 21 10:46:01.428666 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-860c2b0b-587c-4c6e-b77d-50fdc47d1f09 tempest-DeleteServersTestJSON-192729269 tempest-DeleteServersTestJSON-192729269-project] [instance: 70198cde-d4fd-45bc-addf-8f39ec4f7df7] Selected host: n-h2-811414-3; Selected node: n-h2-811414-3; Alternates: [('n-h1-811414-3', 'n-h1-811414-3')] {{(pid=94357) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 21 10:46:01.430049 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-860c2b0b-587c-4c6e-b77d-50fdc47d1f09 tempest-DeleteServersTestJSON-192729269 tempest-DeleteServersTestJSON-192729269-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:46:01.430673 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-860c2b0b-587c-4c6e-b77d-50fdc47d1f09 tempest-DeleteServersTestJSON-192729269 tempest-DeleteServersTestJSON-192729269-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:46:01.438264 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-860c2b0b-587c-4c6e-b77d-50fdc47d1f09 tempest-DeleteServersTestJSON-192729269 tempest-DeleteServersTestJSON-192729269-project] [instance: 70198cde-d4fd-45bc-addf-8f39ec4f7df7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f5cdc3d5-9524-4220-a7fc-ab5606975fdb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94357) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 21 10:46:01.439747 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-860c2b0b-587c-4c6e-b77d-50fdc47d1f09 tempest-DeleteServersTestJSON-192729269 tempest-DeleteServersTestJSON-192729269-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:46:01.440443 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-860c2b0b-587c-4c6e-b77d-50fdc47d1f09 tempest-DeleteServersTestJSON-192729269 tempest-DeleteServersTestJSON-192729269-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:46:01.484276 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-860c2b0b-587c-4c6e-b77d-50fdc47d1f09 tempest-DeleteServersTestJSON-192729269 tempest-DeleteServersTestJSON-192729269-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:46:01.485016 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-860c2b0b-587c-4c6e-b77d-50fdc47d1f09 tempest-DeleteServersTestJSON-192729269 tempest-DeleteServersTestJSON-192729269-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:46:27.739434 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-591cb3ab-ccbe-4866-bf98-261424c6fa83 tempest-MultipleCreateTestJSON-1322971076 tempest-MultipleCreateTestJSON-1322971076-project] Took 0.74 seconds to select destinations for 2 instance(s). {{(pid=94358) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 21 10:46:27.786454 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-591cb3ab-ccbe-4866-bf98-261424c6fa83 tempest-MultipleCreateTestJSON-1322971076 tempest-MultipleCreateTestJSON-1322971076-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:46:27.787124 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-591cb3ab-ccbe-4866-bf98-261424c6fa83 tempest-MultipleCreateTestJSON-1322971076 tempest-MultipleCreateTestJSON-1322971076-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:46:27.869225 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-591cb3ab-ccbe-4866-bf98-261424c6fa83 tempest-MultipleCreateTestJSON-1322971076 tempest-MultipleCreateTestJSON-1322971076-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:46:27.869952 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-591cb3ab-ccbe-4866-bf98-261424c6fa83 tempest-MultipleCreateTestJSON-1322971076 tempest-MultipleCreateTestJSON-1322971076-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:46:27.922673 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-591cb3ab-ccbe-4866-bf98-261424c6fa83 tempest-MultipleCreateTestJSON-1322971076 tempest-MultipleCreateTestJSON-1322971076-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:46:27.923357 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-591cb3ab-ccbe-4866-bf98-261424c6fa83 tempest-MultipleCreateTestJSON-1322971076 tempest-MultipleCreateTestJSON-1322971076-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:46:27.924739 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-591cb3ab-ccbe-4866-bf98-261424c6fa83 tempest-MultipleCreateTestJSON-1322971076 tempest-MultipleCreateTestJSON-1322971076-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:46:27.925832 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-591cb3ab-ccbe-4866-bf98-261424c6fa83 tempest-MultipleCreateTestJSON-1322971076 tempest-MultipleCreateTestJSON-1322971076-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:46:27.948709 n-d-811414-3 nova-conductor[94358]: DEBUG nova.quota [None req-591cb3ab-ccbe-4866-bf98-261424c6fa83 tempest-MultipleCreateTestJSON-1322971076 tempest-MultipleCreateTestJSON-1322971076-project] Getting quotas for project 81c9d3971d7749e891984f99ec6eee34. Resources: {'instances', 'cores', 'ram'} {{(pid=94358) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 21 10:46:27.954509 n-d-811414-3 nova-conductor[94358]: DEBUG nova.quota [None req-591cb3ab-ccbe-4866-bf98-261424c6fa83 tempest-MultipleCreateTestJSON-1322971076 tempest-MultipleCreateTestJSON-1322971076-project] Getting quotas for user dffb8ecca7384918ac43598f746b5301 and project 81c9d3971d7749e891984f99ec6eee34. Resources: {'instances', 'cores', 'ram'} {{(pid=94358) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 21 10:46:27.972429 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-591cb3ab-ccbe-4866-bf98-261424c6fa83 tempest-MultipleCreateTestJSON-1322971076 tempest-MultipleCreateTestJSON-1322971076-project] [instance: 7ee33d5e-a456-4f85-93b3-f1c8d2584575] Selected host: n-h2-811414-3; Selected node: n-h2-811414-3; Alternates: [('n-h1-811414-3', 'n-h1-811414-3')] {{(pid=94358) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 21 10:46:27.973454 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-591cb3ab-ccbe-4866-bf98-261424c6fa83 tempest-MultipleCreateTestJSON-1322971076 tempest-MultipleCreateTestJSON-1322971076-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:46:27.973863 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-591cb3ab-ccbe-4866-bf98-261424c6fa83 tempest-MultipleCreateTestJSON-1322971076 tempest-MultipleCreateTestJSON-1322971076-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:46:27.985481 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-591cb3ab-ccbe-4866-bf98-261424c6fa83 tempest-MultipleCreateTestJSON-1322971076 tempest-MultipleCreateTestJSON-1322971076-project] [instance: 7ee33d5e-a456-4f85-93b3-f1c8d2584575] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f5cdc3d5-9524-4220-a7fc-ab5606975fdb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94358) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 21 10:46:27.986906 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-591cb3ab-ccbe-4866-bf98-261424c6fa83 tempest-MultipleCreateTestJSON-1322971076 tempest-MultipleCreateTestJSON-1322971076-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:46:27.987365 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-591cb3ab-ccbe-4866-bf98-261424c6fa83 tempest-MultipleCreateTestJSON-1322971076 tempest-MultipleCreateTestJSON-1322971076-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:46:28.047083 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-591cb3ab-ccbe-4866-bf98-261424c6fa83 tempest-MultipleCreateTestJSON-1322971076 tempest-MultipleCreateTestJSON-1322971076-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:46:28.047620 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-591cb3ab-ccbe-4866-bf98-261424c6fa83 tempest-MultipleCreateTestJSON-1322971076 tempest-MultipleCreateTestJSON-1322971076-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:46:28.061679 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-591cb3ab-ccbe-4866-bf98-261424c6fa83 tempest-MultipleCreateTestJSON-1322971076 tempest-MultipleCreateTestJSON-1322971076-project] [instance: 252012e1-21d5-4917-aa9e-756bb0a2bd34] Selected host: n-h2-811414-3; Selected node: n-h2-811414-3; Alternates: [('n-h1-811414-3', 'n-h1-811414-3')] {{(pid=94358) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 21 10:46:28.063049 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-591cb3ab-ccbe-4866-bf98-261424c6fa83 tempest-MultipleCreateTestJSON-1322971076 tempest-MultipleCreateTestJSON-1322971076-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:46:28.063613 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-591cb3ab-ccbe-4866-bf98-261424c6fa83 tempest-MultipleCreateTestJSON-1322971076 tempest-MultipleCreateTestJSON-1322971076-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:46:28.088233 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-591cb3ab-ccbe-4866-bf98-261424c6fa83 tempest-MultipleCreateTestJSON-1322971076 tempest-MultipleCreateTestJSON-1322971076-project] [instance: 252012e1-21d5-4917-aa9e-756bb0a2bd34] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f5cdc3d5-9524-4220-a7fc-ab5606975fdb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94358) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 21 10:46:28.090598 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-591cb3ab-ccbe-4866-bf98-261424c6fa83 tempest-MultipleCreateTestJSON-1322971076 tempest-MultipleCreateTestJSON-1322971076-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:46:28.092375 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-591cb3ab-ccbe-4866-bf98-261424c6fa83 tempest-MultipleCreateTestJSON-1322971076 tempest-MultipleCreateTestJSON-1322971076-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:46:28.144969 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-591cb3ab-ccbe-4866-bf98-261424c6fa83 tempest-MultipleCreateTestJSON-1322971076 tempest-MultipleCreateTestJSON-1322971076-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:46:28.145691 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-591cb3ab-ccbe-4866-bf98-261424c6fa83 tempest-MultipleCreateTestJSON-1322971076 tempest-MultipleCreateTestJSON-1322971076-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:46:31.375010 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-ddf0b1c0-aff1-4c54-be25-e977b91985e1 tempest-MigrationsAdminTest-641231928 tempest-MigrationsAdminTest-641231928-project] Took 0.55 seconds to select destinations for 1 instance(s). {{(pid=94357) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 21 10:46:31.467756 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-ddf0b1c0-aff1-4c54-be25-e977b91985e1 tempest-MigrationsAdminTest-641231928 tempest-MigrationsAdminTest-641231928-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:46:31.480983 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-ddf0b1c0-aff1-4c54-be25-e977b91985e1 tempest-MigrationsAdminTest-641231928 tempest-MigrationsAdminTest-641231928-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:46:31.597070 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-1c7ec06e-d4f0-42f0-b06f-120ac0b82559 tempest-ServersTestBootFromVolume-1133035096 tempest-ServersTestBootFromVolume-1133035096-project] Took 0.59 seconds to select destinations for 1 instance(s). {{(pid=94358) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 21 10:46:31.614282 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-ddf0b1c0-aff1-4c54-be25-e977b91985e1 tempest-MigrationsAdminTest-641231928 tempest-MigrationsAdminTest-641231928-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:46:31.614989 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-ddf0b1c0-aff1-4c54-be25-e977b91985e1 tempest-MigrationsAdminTest-641231928 tempest-MigrationsAdminTest-641231928-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:46:31.619696 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-ddf0b1c0-aff1-4c54-be25-e977b91985e1 tempest-MigrationsAdminTest-641231928 tempest-MigrationsAdminTest-641231928-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:46:31.620703 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-ddf0b1c0-aff1-4c54-be25-e977b91985e1 tempest-MigrationsAdminTest-641231928 tempest-MigrationsAdminTest-641231928-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:46:31.662169 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-1c7ec06e-d4f0-42f0-b06f-120ac0b82559 tempest-ServersTestBootFromVolume-1133035096 tempest-ServersTestBootFromVolume-1133035096-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:46:31.665464 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-1c7ec06e-d4f0-42f0-b06f-120ac0b82559 tempest-ServersTestBootFromVolume-1133035096 tempest-ServersTestBootFromVolume-1133035096-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:46:31.691449 n-d-811414-3 nova-conductor[94357]: DEBUG nova.quota [None req-ddf0b1c0-aff1-4c54-be25-e977b91985e1 tempest-MigrationsAdminTest-641231928 tempest-MigrationsAdminTest-641231928-project] Getting quotas for project eaa9a71aac0c466dbbfc09ba3cf71440. Resources: {'instances', 'cores', 'ram'} {{(pid=94357) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 21 10:46:31.710165 n-d-811414-3 nova-conductor[94357]: DEBUG nova.quota [None req-ddf0b1c0-aff1-4c54-be25-e977b91985e1 tempest-MigrationsAdminTest-641231928 tempest-MigrationsAdminTest-641231928-project] Getting quotas for user 521d609e0c8a430fa8f33c9db9870430 and project eaa9a71aac0c466dbbfc09ba3cf71440. Resources: {'instances', 'cores', 'ram'} {{(pid=94357) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 21 10:46:31.738890 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-ddf0b1c0-aff1-4c54-be25-e977b91985e1 tempest-MigrationsAdminTest-641231928 tempest-MigrationsAdminTest-641231928-project] [instance: d810bccb-c738-4290-9b65-a009b6cc0e4e] Selected host: n-h2-811414-3; Selected node: n-h2-811414-3; Alternates: [('n-h1-811414-3', 'n-h1-811414-3')] {{(pid=94357) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 21 10:46:31.741815 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-ddf0b1c0-aff1-4c54-be25-e977b91985e1 tempest-MigrationsAdminTest-641231928 tempest-MigrationsAdminTest-641231928-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:46:31.742234 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-ddf0b1c0-aff1-4c54-be25-e977b91985e1 tempest-MigrationsAdminTest-641231928 tempest-MigrationsAdminTest-641231928-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:46:31.758853 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-ddf0b1c0-aff1-4c54-be25-e977b91985e1 tempest-MigrationsAdminTest-641231928 tempest-MigrationsAdminTest-641231928-project] [instance: d810bccb-c738-4290-9b65-a009b6cc0e4e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f5cdc3d5-9524-4220-a7fc-ab5606975fdb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94357) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 21 10:46:31.760338 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-ddf0b1c0-aff1-4c54-be25-e977b91985e1 tempest-MigrationsAdminTest-641231928 tempest-MigrationsAdminTest-641231928-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:46:31.760918 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-ddf0b1c0-aff1-4c54-be25-e977b91985e1 tempest-MigrationsAdminTest-641231928 tempest-MigrationsAdminTest-641231928-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:46:31.833261 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-ddf0b1c0-aff1-4c54-be25-e977b91985e1 tempest-MigrationsAdminTest-641231928 tempest-MigrationsAdminTest-641231928-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:46:31.833478 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-1c7ec06e-d4f0-42f0-b06f-120ac0b82559 tempest-ServersTestBootFromVolume-1133035096 tempest-ServersTestBootFromVolume-1133035096-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:46:31.833662 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-ddf0b1c0-aff1-4c54-be25-e977b91985e1 tempest-MigrationsAdminTest-641231928 tempest-MigrationsAdminTest-641231928-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:46:31.833980 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-1c7ec06e-d4f0-42f0-b06f-120ac0b82559 tempest-ServersTestBootFromVolume-1133035096 tempest-ServersTestBootFromVolume-1133035096-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:46:31.836520 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-1c7ec06e-d4f0-42f0-b06f-120ac0b82559 tempest-ServersTestBootFromVolume-1133035096 tempest-ServersTestBootFromVolume-1133035096-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:46:31.844784 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-1c7ec06e-d4f0-42f0-b06f-120ac0b82559 tempest-ServersTestBootFromVolume-1133035096 tempest-ServersTestBootFromVolume-1133035096-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:46:31.891144 n-d-811414-3 nova-conductor[94358]: DEBUG nova.quota [None req-1c7ec06e-d4f0-42f0-b06f-120ac0b82559 tempest-ServersTestBootFromVolume-1133035096 tempest-ServersTestBootFromVolume-1133035096-project] Getting quotas for project f935697803584a8fb8e6f40a7822f280. Resources: {'instances', 'cores', 'ram'} {{(pid=94358) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 21 10:46:31.905346 n-d-811414-3 nova-conductor[94358]: DEBUG nova.quota [None req-1c7ec06e-d4f0-42f0-b06f-120ac0b82559 tempest-ServersTestBootFromVolume-1133035096 tempest-ServersTestBootFromVolume-1133035096-project] Getting quotas for user 8428e1c873664ed5a47542c99d12fc9c and project f935697803584a8fb8e6f40a7822f280. Resources: {'instances', 'cores', 'ram'} {{(pid=94358) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 21 10:46:31.939424 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-1c7ec06e-d4f0-42f0-b06f-120ac0b82559 tempest-ServersTestBootFromVolume-1133035096 tempest-ServersTestBootFromVolume-1133035096-project] [instance: a45fb425-f83c-4aa5-9cc0-6a8d1c952477] Selected host: n-h2-811414-3; Selected node: n-h2-811414-3; Alternates: [('n-h1-811414-3', 'n-h1-811414-3')] {{(pid=94358) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 21 10:46:31.942020 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-1c7ec06e-d4f0-42f0-b06f-120ac0b82559 tempest-ServersTestBootFromVolume-1133035096 tempest-ServersTestBootFromVolume-1133035096-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:46:31.942614 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-1c7ec06e-d4f0-42f0-b06f-120ac0b82559 tempest-ServersTestBootFromVolume-1133035096 tempest-ServersTestBootFromVolume-1133035096-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:46:31.961407 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-1c7ec06e-d4f0-42f0-b06f-120ac0b82559 tempest-ServersTestBootFromVolume-1133035096 tempest-ServersTestBootFromVolume-1133035096-project] [instance: a45fb425-f83c-4aa5-9cc0-6a8d1c952477] block_device_mapping [BlockDeviceMapping(attachment_id=52876a8d-0157-4e04-8f55-f33085798f7a,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='8278d77e-7a29-4899-aacd-07b0c6e693d9',volume_size=1,volume_type=None)] {{(pid=94358) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 21 10:46:31.963069 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-1c7ec06e-d4f0-42f0-b06f-120ac0b82559 tempest-ServersTestBootFromVolume-1133035096 tempest-ServersTestBootFromVolume-1133035096-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:46:31.963824 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-1c7ec06e-d4f0-42f0-b06f-120ac0b82559 tempest-ServersTestBootFromVolume-1133035096 tempest-ServersTestBootFromVolume-1133035096-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:46:32.021912 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-1c7ec06e-d4f0-42f0-b06f-120ac0b82559 tempest-ServersTestBootFromVolume-1133035096 tempest-ServersTestBootFromVolume-1133035096-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:46:32.023742 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-1c7ec06e-d4f0-42f0-b06f-120ac0b82559 tempest-ServersTestBootFromVolume-1133035096 tempest-ServersTestBootFromVolume-1133035096-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:46:36.163867 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-2bc1bf7f-81f9-46e3-8156-e92d05655d3c tempest-ImagesOneServerNegativeTestJSON-359199187 tempest-ImagesOneServerNegativeTestJSON-359199187-project] Took 0.48 seconds to select destinations for 1 instance(s). {{(pid=94357) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 21 10:46:36.196551 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-2bc1bf7f-81f9-46e3-8156-e92d05655d3c tempest-ImagesOneServerNegativeTestJSON-359199187 tempest-ImagesOneServerNegativeTestJSON-359199187-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:46:36.197216 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-2bc1bf7f-81f9-46e3-8156-e92d05655d3c tempest-ImagesOneServerNegativeTestJSON-359199187 tempest-ImagesOneServerNegativeTestJSON-359199187-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:46:36.300949 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-2bc1bf7f-81f9-46e3-8156-e92d05655d3c tempest-ImagesOneServerNegativeTestJSON-359199187 tempest-ImagesOneServerNegativeTestJSON-359199187-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:46:36.301418 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-2bc1bf7f-81f9-46e3-8156-e92d05655d3c tempest-ImagesOneServerNegativeTestJSON-359199187 tempest-ImagesOneServerNegativeTestJSON-359199187-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:46:36.307659 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-2bc1bf7f-81f9-46e3-8156-e92d05655d3c tempest-ImagesOneServerNegativeTestJSON-359199187 tempest-ImagesOneServerNegativeTestJSON-359199187-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:46:36.308530 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-2bc1bf7f-81f9-46e3-8156-e92d05655d3c tempest-ImagesOneServerNegativeTestJSON-359199187 tempest-ImagesOneServerNegativeTestJSON-359199187-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:46:36.354095 n-d-811414-3 nova-conductor[94357]: DEBUG nova.quota [None req-2bc1bf7f-81f9-46e3-8156-e92d05655d3c tempest-ImagesOneServerNegativeTestJSON-359199187 tempest-ImagesOneServerNegativeTestJSON-359199187-project] Getting quotas for project 6df93b3e352d426ba326ee59599bb7c4. Resources: {'instances', 'cores', 'ram'} {{(pid=94357) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 21 10:46:36.363151 n-d-811414-3 nova-conductor[94357]: DEBUG nova.quota [None req-2bc1bf7f-81f9-46e3-8156-e92d05655d3c tempest-ImagesOneServerNegativeTestJSON-359199187 tempest-ImagesOneServerNegativeTestJSON-359199187-project] Getting quotas for user 9df52c8bcea14106b61aecdea9d22793 and project 6df93b3e352d426ba326ee59599bb7c4. Resources: {'instances', 'cores', 'ram'} {{(pid=94357) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 21 10:46:36.391412 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-2bc1bf7f-81f9-46e3-8156-e92d05655d3c tempest-ImagesOneServerNegativeTestJSON-359199187 tempest-ImagesOneServerNegativeTestJSON-359199187-project] [instance: 4c594581-15ee-4396-8e79-5b6f8ce43d06] Selected host: n-h2-811414-3; Selected node: n-h2-811414-3; Alternates: [('n-h1-811414-3', 'n-h1-811414-3')] {{(pid=94357) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 21 10:46:36.393561 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-2bc1bf7f-81f9-46e3-8156-e92d05655d3c tempest-ImagesOneServerNegativeTestJSON-359199187 tempest-ImagesOneServerNegativeTestJSON-359199187-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:46:36.397126 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-2bc1bf7f-81f9-46e3-8156-e92d05655d3c tempest-ImagesOneServerNegativeTestJSON-359199187 tempest-ImagesOneServerNegativeTestJSON-359199187-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:46:36.411182 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-2bc1bf7f-81f9-46e3-8156-e92d05655d3c tempest-ImagesOneServerNegativeTestJSON-359199187 tempest-ImagesOneServerNegativeTestJSON-359199187-project] [instance: 4c594581-15ee-4396-8e79-5b6f8ce43d06] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f5cdc3d5-9524-4220-a7fc-ab5606975fdb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94357) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 21 10:46:36.414225 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-2bc1bf7f-81f9-46e3-8156-e92d05655d3c tempest-ImagesOneServerNegativeTestJSON-359199187 tempest-ImagesOneServerNegativeTestJSON-359199187-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:46:36.414842 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-2bc1bf7f-81f9-46e3-8156-e92d05655d3c tempest-ImagesOneServerNegativeTestJSON-359199187 tempest-ImagesOneServerNegativeTestJSON-359199187-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:46:36.478060 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-2bc1bf7f-81f9-46e3-8156-e92d05655d3c tempest-ImagesOneServerNegativeTestJSON-359199187 tempest-ImagesOneServerNegativeTestJSON-359199187-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:46:36.478960 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-2bc1bf7f-81f9-46e3-8156-e92d05655d3c tempest-ImagesOneServerNegativeTestJSON-359199187 tempest-ImagesOneServerNegativeTestJSON-359199187-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:46:46.390519 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-6c2e2fe5-660f-4109-a7fd-9617f6e3bc28 tempest-ListImageFiltersTestJSON-1347812909 tempest-ListImageFiltersTestJSON-1347812909-project] Took 0.45 seconds to select destinations for 1 instance(s). {{(pid=94358) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 21 10:46:46.492262 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-6c2e2fe5-660f-4109-a7fd-9617f6e3bc28 tempest-ListImageFiltersTestJSON-1347812909 tempest-ListImageFiltersTestJSON-1347812909-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:46:46.493499 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-6c2e2fe5-660f-4109-a7fd-9617f6e3bc28 tempest-ListImageFiltersTestJSON-1347812909 tempest-ListImageFiltersTestJSON-1347812909-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:46:46.679429 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-6c2e2fe5-660f-4109-a7fd-9617f6e3bc28 tempest-ListImageFiltersTestJSON-1347812909 tempest-ListImageFiltersTestJSON-1347812909-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:46:46.679429 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-6c2e2fe5-660f-4109-a7fd-9617f6e3bc28 tempest-ListImageFiltersTestJSON-1347812909 tempest-ListImageFiltersTestJSON-1347812909-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:46:46.682095 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-6c2e2fe5-660f-4109-a7fd-9617f6e3bc28 tempest-ListImageFiltersTestJSON-1347812909 tempest-ListImageFiltersTestJSON-1347812909-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:46:46.682490 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-6c2e2fe5-660f-4109-a7fd-9617f6e3bc28 tempest-ListImageFiltersTestJSON-1347812909 tempest-ListImageFiltersTestJSON-1347812909-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:46:46.742950 n-d-811414-3 nova-conductor[94358]: DEBUG nova.quota [None req-6c2e2fe5-660f-4109-a7fd-9617f6e3bc28 tempest-ListImageFiltersTestJSON-1347812909 tempest-ListImageFiltersTestJSON-1347812909-project] Getting quotas for project 8cce5c44b9e64e06a00d64b2760696a0. Resources: {'instances', 'cores', 'ram'} {{(pid=94358) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 21 10:46:46.750277 n-d-811414-3 nova-conductor[94358]: DEBUG nova.quota [None req-6c2e2fe5-660f-4109-a7fd-9617f6e3bc28 tempest-ListImageFiltersTestJSON-1347812909 tempest-ListImageFiltersTestJSON-1347812909-project] Getting quotas for user b85700136a704c3ea92ab873e178d93d and project 8cce5c44b9e64e06a00d64b2760696a0. Resources: {'instances', 'cores', 'ram'} {{(pid=94358) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 21 10:46:46.770945 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-6c2e2fe5-660f-4109-a7fd-9617f6e3bc28 tempest-ListImageFiltersTestJSON-1347812909 tempest-ListImageFiltersTestJSON-1347812909-project] [instance: 1f2c8b61-ab2a-4a38-be7a-e5b3453c64f0] Selected host: n-h2-811414-3; Selected node: n-h2-811414-3; Alternates: [('n-h1-811414-3', 'n-h1-811414-3')] {{(pid=94358) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 21 10:46:46.772635 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-6c2e2fe5-660f-4109-a7fd-9617f6e3bc28 tempest-ListImageFiltersTestJSON-1347812909 tempest-ListImageFiltersTestJSON-1347812909-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:46:46.777150 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-6c2e2fe5-660f-4109-a7fd-9617f6e3bc28 tempest-ListImageFiltersTestJSON-1347812909 tempest-ListImageFiltersTestJSON-1347812909-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:46:46.789759 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-6c2e2fe5-660f-4109-a7fd-9617f6e3bc28 tempest-ListImageFiltersTestJSON-1347812909 tempest-ListImageFiltersTestJSON-1347812909-project] [instance: 1f2c8b61-ab2a-4a38-be7a-e5b3453c64f0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f5cdc3d5-9524-4220-a7fc-ab5606975fdb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94358) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 21 10:46:46.792119 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-6c2e2fe5-660f-4109-a7fd-9617f6e3bc28 tempest-ListImageFiltersTestJSON-1347812909 tempest-ListImageFiltersTestJSON-1347812909-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:46:46.792755 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-6c2e2fe5-660f-4109-a7fd-9617f6e3bc28 tempest-ListImageFiltersTestJSON-1347812909 tempest-ListImageFiltersTestJSON-1347812909-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:46:46.852941 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-6c2e2fe5-660f-4109-a7fd-9617f6e3bc28 tempest-ListImageFiltersTestJSON-1347812909 tempest-ListImageFiltersTestJSON-1347812909-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:46:46.853438 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-6c2e2fe5-660f-4109-a7fd-9617f6e3bc28 tempest-ListImageFiltersTestJSON-1347812909 tempest-ListImageFiltersTestJSON-1347812909-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:46:48.756214 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-3e5bb3ce-eedf-4e19-9231-e119eb92b3bd tempest-ListImageFiltersTestJSON-1347812909 tempest-ListImageFiltersTestJSON-1347812909-project] Took 0.40 seconds to select destinations for 1 instance(s). {{(pid=94357) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 21 10:46:48.800503 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-3e5bb3ce-eedf-4e19-9231-e119eb92b3bd tempest-ListImageFiltersTestJSON-1347812909 tempest-ListImageFiltersTestJSON-1347812909-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:46:48.800899 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-3e5bb3ce-eedf-4e19-9231-e119eb92b3bd tempest-ListImageFiltersTestJSON-1347812909 tempest-ListImageFiltersTestJSON-1347812909-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:46:48.939468 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-3e5bb3ce-eedf-4e19-9231-e119eb92b3bd tempest-ListImageFiltersTestJSON-1347812909 tempest-ListImageFiltersTestJSON-1347812909-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:46:48.940511 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-3e5bb3ce-eedf-4e19-9231-e119eb92b3bd tempest-ListImageFiltersTestJSON-1347812909 tempest-ListImageFiltersTestJSON-1347812909-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:46:48.941675 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-3e5bb3ce-eedf-4e19-9231-e119eb92b3bd tempest-ListImageFiltersTestJSON-1347812909 tempest-ListImageFiltersTestJSON-1347812909-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:46:48.942452 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-3e5bb3ce-eedf-4e19-9231-e119eb92b3bd tempest-ListImageFiltersTestJSON-1347812909 tempest-ListImageFiltersTestJSON-1347812909-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:46:48.977988 n-d-811414-3 nova-conductor[94357]: DEBUG nova.quota [None req-3e5bb3ce-eedf-4e19-9231-e119eb92b3bd tempest-ListImageFiltersTestJSON-1347812909 tempest-ListImageFiltersTestJSON-1347812909-project] Getting quotas for project 8cce5c44b9e64e06a00d64b2760696a0. Resources: {'instances', 'cores', 'ram'} {{(pid=94357) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 21 10:46:48.992430 n-d-811414-3 nova-conductor[94357]: DEBUG nova.quota [None req-3e5bb3ce-eedf-4e19-9231-e119eb92b3bd tempest-ListImageFiltersTestJSON-1347812909 tempest-ListImageFiltersTestJSON-1347812909-project] Getting quotas for user b85700136a704c3ea92ab873e178d93d and project 8cce5c44b9e64e06a00d64b2760696a0. Resources: {'instances', 'cores', 'ram'} {{(pid=94357) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 21 10:46:49.024082 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-3e5bb3ce-eedf-4e19-9231-e119eb92b3bd tempest-ListImageFiltersTestJSON-1347812909 tempest-ListImageFiltersTestJSON-1347812909-project] [instance: bc511543-bb08-45c6-9d90-4aaf46a76935] Selected host: n-h2-811414-3; Selected node: n-h2-811414-3; Alternates: [('n-h1-811414-3', 'n-h1-811414-3')] {{(pid=94357) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 21 10:46:49.028695 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-3e5bb3ce-eedf-4e19-9231-e119eb92b3bd tempest-ListImageFiltersTestJSON-1347812909 tempest-ListImageFiltersTestJSON-1347812909-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:46:49.029606 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-3e5bb3ce-eedf-4e19-9231-e119eb92b3bd tempest-ListImageFiltersTestJSON-1347812909 tempest-ListImageFiltersTestJSON-1347812909-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:46:49.049264 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-3e5bb3ce-eedf-4e19-9231-e119eb92b3bd tempest-ListImageFiltersTestJSON-1347812909 tempest-ListImageFiltersTestJSON-1347812909-project] [instance: bc511543-bb08-45c6-9d90-4aaf46a76935] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f5cdc3d5-9524-4220-a7fc-ab5606975fdb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94357) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 21 10:46:49.052968 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-3e5bb3ce-eedf-4e19-9231-e119eb92b3bd tempest-ListImageFiltersTestJSON-1347812909 tempest-ListImageFiltersTestJSON-1347812909-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:46:49.054095 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-3e5bb3ce-eedf-4e19-9231-e119eb92b3bd tempest-ListImageFiltersTestJSON-1347812909 tempest-ListImageFiltersTestJSON-1347812909-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:46:49.138535 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-3e5bb3ce-eedf-4e19-9231-e119eb92b3bd tempest-ListImageFiltersTestJSON-1347812909 tempest-ListImageFiltersTestJSON-1347812909-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:46:49.139038 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-3e5bb3ce-eedf-4e19-9231-e119eb92b3bd tempest-ListImageFiltersTestJSON-1347812909 tempest-ListImageFiltersTestJSON-1347812909-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:46:55.979135 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-a9c34c2a-670b-4dc2-b9d5-60a188a53963 tempest-ImagesTestJSON-2141840651 tempest-ImagesTestJSON-2141840651-project] Took 0.48 seconds to select destinations for 1 instance(s). {{(pid=94358) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 21 10:46:56.039349 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-a9c34c2a-670b-4dc2-b9d5-60a188a53963 tempest-ImagesTestJSON-2141840651 tempest-ImagesTestJSON-2141840651-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:46:56.039720 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-a9c34c2a-670b-4dc2-b9d5-60a188a53963 tempest-ImagesTestJSON-2141840651 tempest-ImagesTestJSON-2141840651-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:46:56.143236 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-a9c34c2a-670b-4dc2-b9d5-60a188a53963 tempest-ImagesTestJSON-2141840651 tempest-ImagesTestJSON-2141840651-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:46:56.144712 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-a9c34c2a-670b-4dc2-b9d5-60a188a53963 tempest-ImagesTestJSON-2141840651 tempest-ImagesTestJSON-2141840651-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:46:56.145462 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-a9c34c2a-670b-4dc2-b9d5-60a188a53963 tempest-ImagesTestJSON-2141840651 tempest-ImagesTestJSON-2141840651-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:46:56.145865 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-a9c34c2a-670b-4dc2-b9d5-60a188a53963 tempest-ImagesTestJSON-2141840651 tempest-ImagesTestJSON-2141840651-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:46:56.185037 n-d-811414-3 nova-conductor[94358]: DEBUG nova.quota [None req-a9c34c2a-670b-4dc2-b9d5-60a188a53963 tempest-ImagesTestJSON-2141840651 tempest-ImagesTestJSON-2141840651-project] Getting quotas for project 0bba3afe8fe04b9f9288dc0d33f6719e. Resources: {'instances', 'cores', 'ram'} {{(pid=94358) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 21 10:46:56.191808 n-d-811414-3 nova-conductor[94358]: DEBUG nova.quota [None req-a9c34c2a-670b-4dc2-b9d5-60a188a53963 tempest-ImagesTestJSON-2141840651 tempest-ImagesTestJSON-2141840651-project] Getting quotas for user efce50a365d3495eab4a41e5063cdfc7 and project 0bba3afe8fe04b9f9288dc0d33f6719e. Resources: {'instances', 'cores', 'ram'} {{(pid=94358) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 21 10:46:56.203981 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-a9c34c2a-670b-4dc2-b9d5-60a188a53963 tempest-ImagesTestJSON-2141840651 tempest-ImagesTestJSON-2141840651-project] [instance: 3ff800f4-a2b9-44a5-962d-f34dd17e2564] Selected host: n-h2-811414-3; Selected node: n-h2-811414-3; Alternates: [('n-h1-811414-3', 'n-h1-811414-3')] {{(pid=94358) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 21 10:46:56.205214 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-a9c34c2a-670b-4dc2-b9d5-60a188a53963 tempest-ImagesTestJSON-2141840651 tempest-ImagesTestJSON-2141840651-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:46:56.205826 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-a9c34c2a-670b-4dc2-b9d5-60a188a53963 tempest-ImagesTestJSON-2141840651 tempest-ImagesTestJSON-2141840651-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:46:56.216918 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-a9c34c2a-670b-4dc2-b9d5-60a188a53963 tempest-ImagesTestJSON-2141840651 tempest-ImagesTestJSON-2141840651-project] [instance: 3ff800f4-a2b9-44a5-962d-f34dd17e2564] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f5cdc3d5-9524-4220-a7fc-ab5606975fdb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94358) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 21 10:46:56.219186 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-a9c34c2a-670b-4dc2-b9d5-60a188a53963 tempest-ImagesTestJSON-2141840651 tempest-ImagesTestJSON-2141840651-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:46:56.219654 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-a9c34c2a-670b-4dc2-b9d5-60a188a53963 tempest-ImagesTestJSON-2141840651 tempest-ImagesTestJSON-2141840651-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:46:56.269775 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-a9c34c2a-670b-4dc2-b9d5-60a188a53963 tempest-ImagesTestJSON-2141840651 tempest-ImagesTestJSON-2141840651-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:46:56.270286 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-a9c34c2a-670b-4dc2-b9d5-60a188a53963 tempest-ImagesTestJSON-2141840651 tempest-ImagesTestJSON-2141840651-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:47:05.120595 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-6d3f2334-68d2-443c-9315-a60375cec597 tempest-MigrationsAdminTest-1313869673 tempest-MigrationsAdminTest-1313869673-project-admin] Targeting cell 6c99d8ec-fb48-48af-b02b-a629a7c2cb6b(cell1) for conductor method migrate_server {{(pid=94357) wrapper /opt/stack/nova/nova/conductor/manager.py:91}} Apr 21 10:47:05.121693 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-6d3f2334-68d2-443c-9315-a60375cec597 tempest-MigrationsAdminTest-1313869673 tempest-MigrationsAdminTest-1313869673-project-admin] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:47:05.122273 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-6d3f2334-68d2-443c-9315-a60375cec597 tempest-MigrationsAdminTest-1313869673 tempest-MigrationsAdminTest-1313869673-project-admin] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:47:06.096011 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-5fbc6ee1-5a09-4a60-8110-d616f6bccab0 tempest-ServersTestJSON-1635484940 tempest-ServersTestJSON-1635484940-project] Took 0.42 seconds to select destinations for 1 instance(s). {{(pid=94358) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 21 10:47:06.163930 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-5fbc6ee1-5a09-4a60-8110-d616f6bccab0 tempest-ServersTestJSON-1635484940 tempest-ServersTestJSON-1635484940-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:47:06.164417 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-5fbc6ee1-5a09-4a60-8110-d616f6bccab0 tempest-ServersTestJSON-1635484940 tempest-ServersTestJSON-1635484940-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:47:06.266151 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-5fbc6ee1-5a09-4a60-8110-d616f6bccab0 tempest-ServersTestJSON-1635484940 tempest-ServersTestJSON-1635484940-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:47:06.266565 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-5fbc6ee1-5a09-4a60-8110-d616f6bccab0 tempest-ServersTestJSON-1635484940 tempest-ServersTestJSON-1635484940-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:47:06.267292 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-5fbc6ee1-5a09-4a60-8110-d616f6bccab0 tempest-ServersTestJSON-1635484940 tempest-ServersTestJSON-1635484940-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:47:06.267687 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-5fbc6ee1-5a09-4a60-8110-d616f6bccab0 tempest-ServersTestJSON-1635484940 tempest-ServersTestJSON-1635484940-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:47:06.330809 n-d-811414-3 nova-conductor[94358]: DEBUG nova.quota [None req-5fbc6ee1-5a09-4a60-8110-d616f6bccab0 tempest-ServersTestJSON-1635484940 tempest-ServersTestJSON-1635484940-project] Getting quotas for project a9a93807798c4c57a168de3450f3f241. Resources: {'instances', 'cores', 'ram'} {{(pid=94358) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 21 10:47:06.335436 n-d-811414-3 nova-conductor[94358]: DEBUG nova.quota [None req-5fbc6ee1-5a09-4a60-8110-d616f6bccab0 tempest-ServersTestJSON-1635484940 tempest-ServersTestJSON-1635484940-project] Getting quotas for user d354ec959b324a689b75a37dff0877af and project a9a93807798c4c57a168de3450f3f241. Resources: {'instances', 'cores', 'ram'} {{(pid=94358) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 21 10:47:06.359831 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-5fbc6ee1-5a09-4a60-8110-d616f6bccab0 tempest-ServersTestJSON-1635484940 tempest-ServersTestJSON-1635484940-project] [instance: 0beffd48-2027-45ff-b6ea-61c4a8b516c1] Selected host: n-h2-811414-3; Selected node: n-h2-811414-3; Alternates: [('n-h1-811414-3', 'n-h1-811414-3')] {{(pid=94358) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 21 10:47:06.361038 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-5fbc6ee1-5a09-4a60-8110-d616f6bccab0 tempest-ServersTestJSON-1635484940 tempest-ServersTestJSON-1635484940-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:47:06.361604 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-5fbc6ee1-5a09-4a60-8110-d616f6bccab0 tempest-ServersTestJSON-1635484940 tempest-ServersTestJSON-1635484940-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:47:06.375575 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-5fbc6ee1-5a09-4a60-8110-d616f6bccab0 tempest-ServersTestJSON-1635484940 tempest-ServersTestJSON-1635484940-project] [instance: 0beffd48-2027-45ff-b6ea-61c4a8b516c1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f5cdc3d5-9524-4220-a7fc-ab5606975fdb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94358) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 21 10:47:06.377173 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-5fbc6ee1-5a09-4a60-8110-d616f6bccab0 tempest-ServersTestJSON-1635484940 tempest-ServersTestJSON-1635484940-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:47:06.377744 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-5fbc6ee1-5a09-4a60-8110-d616f6bccab0 tempest-ServersTestJSON-1635484940 tempest-ServersTestJSON-1635484940-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:47:06.467017 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.tasks.migrate [None req-6d3f2334-68d2-443c-9315-a60375cec597 tempest-MigrationsAdminTest-1313869673 tempest-MigrationsAdminTest-1313869673-project-admin] [instance: d810bccb-c738-4290-9b65-a009b6cc0e4e] Restricting to cell 6c99d8ec-fb48-48af-b02b-a629a7c2cb6b(cell1) while migrating {{(pid=94357) _set_requested_destination_cell /opt/stack/nova/nova/conductor/tasks/migrate.py:208}} Apr 21 10:47:06.468892 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-5fbc6ee1-5a09-4a60-8110-d616f6bccab0 tempest-ServersTestJSON-1635484940 tempest-ServersTestJSON-1635484940-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:47:06.469314 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-5fbc6ee1-5a09-4a60-8110-d616f6bccab0 tempest-ServersTestJSON-1635484940 tempest-ServersTestJSON-1635484940-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:47:07.225673 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.tasks.migrate [None req-6d3f2334-68d2-443c-9315-a60375cec597 tempest-MigrationsAdminTest-1313869673 tempest-MigrationsAdminTest-1313869673-project-admin] Created allocations for migration c015093f-7b5f-4e2a-bcd4-0d264ecbe0e9 on 6ea3f8b1-0c53-40ba-ba27-f80f78a284a6 {{(pid=94357) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} Apr 21 10:47:07.714430 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.tasks.migrate [None req-6d3f2334-68d2-443c-9315-a60375cec597 tempest-MigrationsAdminTest-1313869673 tempest-MigrationsAdminTest-1313869673-project-admin] [instance: d810bccb-c738-4290-9b65-a009b6cc0e4e] Calling prep_resize with selected host: n-h1-811414-3; Selected node: n-h1-811414-3; Alternates: [] {{(pid=94357) _execute /opt/stack/nova/nova/conductor/tasks/migrate.py:315}} Apr 21 10:47:09.891599 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-d1f58f78-8761-44f8-867b-282a0ae43320 tempest-MultipleCreateTestJSON-1322971076 tempest-MultipleCreateTestJSON-1322971076-project] Took 0.52 seconds to select destinations for 2 instance(s). {{(pid=94357) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 21 10:47:09.931612 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-d1f58f78-8761-44f8-867b-282a0ae43320 tempest-MultipleCreateTestJSON-1322971076 tempest-MultipleCreateTestJSON-1322971076-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:47:09.932675 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-d1f58f78-8761-44f8-867b-282a0ae43320 tempest-MultipleCreateTestJSON-1322971076 tempest-MultipleCreateTestJSON-1322971076-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:47:10.021407 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-d1f58f78-8761-44f8-867b-282a0ae43320 tempest-MultipleCreateTestJSON-1322971076 tempest-MultipleCreateTestJSON-1322971076-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:47:10.022173 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-d1f58f78-8761-44f8-867b-282a0ae43320 tempest-MultipleCreateTestJSON-1322971076 tempest-MultipleCreateTestJSON-1322971076-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:47:10.133187 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-d1f58f78-8761-44f8-867b-282a0ae43320 tempest-MultipleCreateTestJSON-1322971076 tempest-MultipleCreateTestJSON-1322971076-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:47:10.133642 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-d1f58f78-8761-44f8-867b-282a0ae43320 tempest-MultipleCreateTestJSON-1322971076 tempest-MultipleCreateTestJSON-1322971076-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:47:10.134519 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-d1f58f78-8761-44f8-867b-282a0ae43320 tempest-MultipleCreateTestJSON-1322971076 tempest-MultipleCreateTestJSON-1322971076-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:47:10.134921 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-d1f58f78-8761-44f8-867b-282a0ae43320 tempest-MultipleCreateTestJSON-1322971076 tempest-MultipleCreateTestJSON-1322971076-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:47:10.156734 n-d-811414-3 nova-conductor[94357]: DEBUG nova.quota [None req-d1f58f78-8761-44f8-867b-282a0ae43320 tempest-MultipleCreateTestJSON-1322971076 tempest-MultipleCreateTestJSON-1322971076-project] Getting quotas for project 81c9d3971d7749e891984f99ec6eee34. Resources: {'instances', 'cores', 'ram'} {{(pid=94357) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 21 10:47:10.163682 n-d-811414-3 nova-conductor[94357]: DEBUG nova.quota [None req-d1f58f78-8761-44f8-867b-282a0ae43320 tempest-MultipleCreateTestJSON-1322971076 tempest-MultipleCreateTestJSON-1322971076-project] Getting quotas for user dffb8ecca7384918ac43598f746b5301 and project 81c9d3971d7749e891984f99ec6eee34. Resources: {'instances', 'cores', 'ram'} {{(pid=94357) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 21 10:47:10.178813 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-d1f58f78-8761-44f8-867b-282a0ae43320 tempest-MultipleCreateTestJSON-1322971076 tempest-MultipleCreateTestJSON-1322971076-project] [instance: 9d0b290a-a2ec-44e0-bc65-d9cd0b10e829] Selected host: n-h2-811414-3; Selected node: n-h2-811414-3; Alternates: [('n-h1-811414-3', 'n-h1-811414-3')] {{(pid=94357) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 21 10:47:10.179779 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-d1f58f78-8761-44f8-867b-282a0ae43320 tempest-MultipleCreateTestJSON-1322971076 tempest-MultipleCreateTestJSON-1322971076-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:47:10.180187 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-d1f58f78-8761-44f8-867b-282a0ae43320 tempest-MultipleCreateTestJSON-1322971076 tempest-MultipleCreateTestJSON-1322971076-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:47:10.201533 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-d1f58f78-8761-44f8-867b-282a0ae43320 tempest-MultipleCreateTestJSON-1322971076 tempest-MultipleCreateTestJSON-1322971076-project] [instance: 9d0b290a-a2ec-44e0-bc65-d9cd0b10e829] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f5cdc3d5-9524-4220-a7fc-ab5606975fdb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94357) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 21 10:47:10.202884 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-d1f58f78-8761-44f8-867b-282a0ae43320 tempest-MultipleCreateTestJSON-1322971076 tempest-MultipleCreateTestJSON-1322971076-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:47:10.203474 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-d1f58f78-8761-44f8-867b-282a0ae43320 tempest-MultipleCreateTestJSON-1322971076 tempest-MultipleCreateTestJSON-1322971076-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:47:10.250225 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-d1f58f78-8761-44f8-867b-282a0ae43320 tempest-MultipleCreateTestJSON-1322971076 tempest-MultipleCreateTestJSON-1322971076-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:47:10.251387 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-d1f58f78-8761-44f8-867b-282a0ae43320 tempest-MultipleCreateTestJSON-1322971076 tempest-MultipleCreateTestJSON-1322971076-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:47:10.279828 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-d1f58f78-8761-44f8-867b-282a0ae43320 tempest-MultipleCreateTestJSON-1322971076 tempest-MultipleCreateTestJSON-1322971076-project] [instance: e041e023-6aa1-4d8c-8326-f96ff88775c8] Selected host: n-h2-811414-3; Selected node: n-h2-811414-3; Alternates: [('n-h1-811414-3', 'n-h1-811414-3')] {{(pid=94357) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 21 10:47:10.282817 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-d1f58f78-8761-44f8-867b-282a0ae43320 tempest-MultipleCreateTestJSON-1322971076 tempest-MultipleCreateTestJSON-1322971076-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:47:10.283235 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-d1f58f78-8761-44f8-867b-282a0ae43320 tempest-MultipleCreateTestJSON-1322971076 tempest-MultipleCreateTestJSON-1322971076-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:47:10.311129 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-d1f58f78-8761-44f8-867b-282a0ae43320 tempest-MultipleCreateTestJSON-1322971076 tempest-MultipleCreateTestJSON-1322971076-project] [instance: e041e023-6aa1-4d8c-8326-f96ff88775c8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f5cdc3d5-9524-4220-a7fc-ab5606975fdb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94357) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 21 10:47:10.312533 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-d1f58f78-8761-44f8-867b-282a0ae43320 tempest-MultipleCreateTestJSON-1322971076 tempest-MultipleCreateTestJSON-1322971076-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:47:10.312939 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-d1f58f78-8761-44f8-867b-282a0ae43320 tempest-MultipleCreateTestJSON-1322971076 tempest-MultipleCreateTestJSON-1322971076-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:47:10.388783 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-d1f58f78-8761-44f8-867b-282a0ae43320 tempest-MultipleCreateTestJSON-1322971076 tempest-MultipleCreateTestJSON-1322971076-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:47:10.389273 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-d1f58f78-8761-44f8-867b-282a0ae43320 tempest-MultipleCreateTestJSON-1322971076 tempest-MultipleCreateTestJSON-1322971076-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:47:11.374732 n-d-811414-3 nova-conductor[94357]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 21 10:47:29.512239 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-c0db5753-c74d-4c18-9e68-35c18b43881a tempest-DeleteServersTestJSON-192729269 tempest-DeleteServersTestJSON-192729269-project] Took 0.28 seconds to select destinations for 1 instance(s). {{(pid=94358) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 21 10:47:29.554367 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-c0db5753-c74d-4c18-9e68-35c18b43881a tempest-DeleteServersTestJSON-192729269 tempest-DeleteServersTestJSON-192729269-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:47:29.555108 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-c0db5753-c74d-4c18-9e68-35c18b43881a tempest-DeleteServersTestJSON-192729269 tempest-DeleteServersTestJSON-192729269-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:47:29.613165 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-c0db5753-c74d-4c18-9e68-35c18b43881a tempest-DeleteServersTestJSON-192729269 tempest-DeleteServersTestJSON-192729269-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:47:29.613924 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-c0db5753-c74d-4c18-9e68-35c18b43881a tempest-DeleteServersTestJSON-192729269 tempest-DeleteServersTestJSON-192729269-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:47:29.615515 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-c0db5753-c74d-4c18-9e68-35c18b43881a tempest-DeleteServersTestJSON-192729269 tempest-DeleteServersTestJSON-192729269-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:47:29.616107 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-c0db5753-c74d-4c18-9e68-35c18b43881a tempest-DeleteServersTestJSON-192729269 tempest-DeleteServersTestJSON-192729269-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:47:29.634202 n-d-811414-3 nova-conductor[94358]: DEBUG nova.quota [None req-c0db5753-c74d-4c18-9e68-35c18b43881a tempest-DeleteServersTestJSON-192729269 tempest-DeleteServersTestJSON-192729269-project] Getting quotas for project 37786f41cece448d819cedcc10899423. Resources: {'instances', 'cores', 'ram'} {{(pid=94358) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 21 10:47:29.639541 n-d-811414-3 nova-conductor[94358]: DEBUG nova.quota [None req-c0db5753-c74d-4c18-9e68-35c18b43881a tempest-DeleteServersTestJSON-192729269 tempest-DeleteServersTestJSON-192729269-project] Getting quotas for user 37fbf69bd6394006b1977bd1d651621f and project 37786f41cece448d819cedcc10899423. Resources: {'instances', 'cores', 'ram'} {{(pid=94358) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 21 10:47:29.656948 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-c0db5753-c74d-4c18-9e68-35c18b43881a tempest-DeleteServersTestJSON-192729269 tempest-DeleteServersTestJSON-192729269-project] [instance: 161b5697-5d91-44f2-a29c-f87ef7ffa564] Selected host: n-h2-811414-3; Selected node: n-h2-811414-3; Alternates: [('n-h1-811414-3', 'n-h1-811414-3')] {{(pid=94358) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 21 10:47:29.662880 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-c0db5753-c74d-4c18-9e68-35c18b43881a tempest-DeleteServersTestJSON-192729269 tempest-DeleteServersTestJSON-192729269-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:47:29.663324 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-c0db5753-c74d-4c18-9e68-35c18b43881a tempest-DeleteServersTestJSON-192729269 tempest-DeleteServersTestJSON-192729269-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:47:29.672986 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-c0db5753-c74d-4c18-9e68-35c18b43881a tempest-DeleteServersTestJSON-192729269 tempest-DeleteServersTestJSON-192729269-project] [instance: 161b5697-5d91-44f2-a29c-f87ef7ffa564] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f5cdc3d5-9524-4220-a7fc-ab5606975fdb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94358) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 21 10:47:29.677081 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-c0db5753-c74d-4c18-9e68-35c18b43881a tempest-DeleteServersTestJSON-192729269 tempest-DeleteServersTestJSON-192729269-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:47:29.677815 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-c0db5753-c74d-4c18-9e68-35c18b43881a tempest-DeleteServersTestJSON-192729269 tempest-DeleteServersTestJSON-192729269-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:47:29.737955 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-c0db5753-c74d-4c18-9e68-35c18b43881a tempest-DeleteServersTestJSON-192729269 tempest-DeleteServersTestJSON-192729269-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:47:29.738498 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-c0db5753-c74d-4c18-9e68-35c18b43881a tempest-DeleteServersTestJSON-192729269 tempest-DeleteServersTestJSON-192729269-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:47:31.957404 n-d-811414-3 nova-conductor[94358]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f60095b5-b68f-459e-af9a-3776dcd48c13] AMQP server on 10.222.0.13:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 21 10:47:32.951860 n-d-811414-3 nova-conductor[94358]: INFO oslo.messaging._drivers.impl_rabbit [-] [f60095b5-b68f-459e-af9a-3776dcd48c13] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 47202. Apr 21 10:47:47.683572 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-68dc07c6-0897-4674-b69c-1a7613444913 tempest-ImagesOneServerNegativeTestJSON-359199187 tempest-ImagesOneServerNegativeTestJSON-359199187-project] Took 0.39 seconds to select destinations for 1 instance(s). {{(pid=94357) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 21 10:47:47.716598 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-68dc07c6-0897-4674-b69c-1a7613444913 tempest-ImagesOneServerNegativeTestJSON-359199187 tempest-ImagesOneServerNegativeTestJSON-359199187-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:47:47.717206 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-68dc07c6-0897-4674-b69c-1a7613444913 tempest-ImagesOneServerNegativeTestJSON-359199187 tempest-ImagesOneServerNegativeTestJSON-359199187-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:47:47.776662 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-68dc07c6-0897-4674-b69c-1a7613444913 tempest-ImagesOneServerNegativeTestJSON-359199187 tempest-ImagesOneServerNegativeTestJSON-359199187-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:47:47.777068 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-68dc07c6-0897-4674-b69c-1a7613444913 tempest-ImagesOneServerNegativeTestJSON-359199187 tempest-ImagesOneServerNegativeTestJSON-359199187-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:47:47.780633 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-68dc07c6-0897-4674-b69c-1a7613444913 tempest-ImagesOneServerNegativeTestJSON-359199187 tempest-ImagesOneServerNegativeTestJSON-359199187-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:47:47.780633 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-68dc07c6-0897-4674-b69c-1a7613444913 tempest-ImagesOneServerNegativeTestJSON-359199187 tempest-ImagesOneServerNegativeTestJSON-359199187-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:47:47.818080 n-d-811414-3 nova-conductor[94357]: DEBUG nova.quota [None req-68dc07c6-0897-4674-b69c-1a7613444913 tempest-ImagesOneServerNegativeTestJSON-359199187 tempest-ImagesOneServerNegativeTestJSON-359199187-project] Getting quotas for project 6df93b3e352d426ba326ee59599bb7c4. Resources: {'instances', 'cores', 'ram'} {{(pid=94357) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 21 10:47:47.824652 n-d-811414-3 nova-conductor[94357]: DEBUG nova.quota [None req-68dc07c6-0897-4674-b69c-1a7613444913 tempest-ImagesOneServerNegativeTestJSON-359199187 tempest-ImagesOneServerNegativeTestJSON-359199187-project] Getting quotas for user 9df52c8bcea14106b61aecdea9d22793 and project 6df93b3e352d426ba326ee59599bb7c4. Resources: {'instances', 'cores', 'ram'} {{(pid=94357) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 21 10:47:47.835882 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-68dc07c6-0897-4674-b69c-1a7613444913 tempest-ImagesOneServerNegativeTestJSON-359199187 tempest-ImagesOneServerNegativeTestJSON-359199187-project] [instance: 0ec4dd06-942f-4cec-a0fe-09820c537d73] Selected host: n-h2-811414-3; Selected node: n-h2-811414-3; Alternates: [('n-h1-811414-3', 'n-h1-811414-3')] {{(pid=94357) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 21 10:47:47.836908 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-68dc07c6-0897-4674-b69c-1a7613444913 tempest-ImagesOneServerNegativeTestJSON-359199187 tempest-ImagesOneServerNegativeTestJSON-359199187-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:47:47.837506 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-68dc07c6-0897-4674-b69c-1a7613444913 tempest-ImagesOneServerNegativeTestJSON-359199187 tempest-ImagesOneServerNegativeTestJSON-359199187-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:47:47.850059 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-68dc07c6-0897-4674-b69c-1a7613444913 tempest-ImagesOneServerNegativeTestJSON-359199187 tempest-ImagesOneServerNegativeTestJSON-359199187-project] [instance: 0ec4dd06-942f-4cec-a0fe-09820c537d73] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f5cdc3d5-9524-4220-a7fc-ab5606975fdb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94357) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 21 10:47:47.850059 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-68dc07c6-0897-4674-b69c-1a7613444913 tempest-ImagesOneServerNegativeTestJSON-359199187 tempest-ImagesOneServerNegativeTestJSON-359199187-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:47:47.851441 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-68dc07c6-0897-4674-b69c-1a7613444913 tempest-ImagesOneServerNegativeTestJSON-359199187 tempest-ImagesOneServerNegativeTestJSON-359199187-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:47:47.914274 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-68dc07c6-0897-4674-b69c-1a7613444913 tempest-ImagesOneServerNegativeTestJSON-359199187 tempest-ImagesOneServerNegativeTestJSON-359199187-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:47:47.914274 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-68dc07c6-0897-4674-b69c-1a7613444913 tempest-ImagesOneServerNegativeTestJSON-359199187 tempest-ImagesOneServerNegativeTestJSON-359199187-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:47:58.120221 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-05e62bfc-cf4c-486d-a771-97ce4349d3a3 tempest-ServersNegativeTestJSON-703029332 tempest-ServersNegativeTestJSON-703029332-project] Took 0.36 seconds to select destinations for 1 instance(s). {{(pid=94358) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 21 10:47:58.157918 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-05e62bfc-cf4c-486d-a771-97ce4349d3a3 tempest-ServersNegativeTestJSON-703029332 tempest-ServersNegativeTestJSON-703029332-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:47:58.158111 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-05e62bfc-cf4c-486d-a771-97ce4349d3a3 tempest-ServersNegativeTestJSON-703029332 tempest-ServersNegativeTestJSON-703029332-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:47:58.266029 n-d-811414-3 nova-conductor[94358]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 21 10:47:58.327146 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-05e62bfc-cf4c-486d-a771-97ce4349d3a3 tempest-ServersNegativeTestJSON-703029332 tempest-ServersNegativeTestJSON-703029332-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:47:58.327551 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-05e62bfc-cf4c-486d-a771-97ce4349d3a3 tempest-ServersNegativeTestJSON-703029332 tempest-ServersNegativeTestJSON-703029332-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:47:58.328611 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-05e62bfc-cf4c-486d-a771-97ce4349d3a3 tempest-ServersNegativeTestJSON-703029332 tempest-ServersNegativeTestJSON-703029332-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:47:58.329143 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-05e62bfc-cf4c-486d-a771-97ce4349d3a3 tempest-ServersNegativeTestJSON-703029332 tempest-ServersNegativeTestJSON-703029332-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:47:58.369960 n-d-811414-3 nova-conductor[94358]: DEBUG nova.quota [None req-05e62bfc-cf4c-486d-a771-97ce4349d3a3 tempest-ServersNegativeTestJSON-703029332 tempest-ServersNegativeTestJSON-703029332-project] Getting quotas for project e96f3c3693b04468af85382414cc5bf9. Resources: {'instances', 'cores', 'ram'} {{(pid=94358) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 21 10:47:58.377081 n-d-811414-3 nova-conductor[94358]: DEBUG nova.quota [None req-05e62bfc-cf4c-486d-a771-97ce4349d3a3 tempest-ServersNegativeTestJSON-703029332 tempest-ServersNegativeTestJSON-703029332-project] Getting quotas for user a2c15cc9caef40ff89c96c0dca8aec26 and project e96f3c3693b04468af85382414cc5bf9. Resources: {'instances', 'cores', 'ram'} {{(pid=94358) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 21 10:47:58.405271 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-05e62bfc-cf4c-486d-a771-97ce4349d3a3 tempest-ServersNegativeTestJSON-703029332 tempest-ServersNegativeTestJSON-703029332-project] [instance: 99ea8b69-c986-4acc-a604-c7db07129f1e] Selected host: n-h2-811414-3; Selected node: n-h2-811414-3; Alternates: [('n-h1-811414-3', 'n-h1-811414-3')] {{(pid=94358) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 21 10:47:58.406465 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-05e62bfc-cf4c-486d-a771-97ce4349d3a3 tempest-ServersNegativeTestJSON-703029332 tempest-ServersNegativeTestJSON-703029332-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:47:58.407707 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-05e62bfc-cf4c-486d-a771-97ce4349d3a3 tempest-ServersNegativeTestJSON-703029332 tempest-ServersNegativeTestJSON-703029332-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:47:58.422262 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-05e62bfc-cf4c-486d-a771-97ce4349d3a3 tempest-ServersNegativeTestJSON-703029332 tempest-ServersNegativeTestJSON-703029332-project] [instance: 99ea8b69-c986-4acc-a604-c7db07129f1e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f5cdc3d5-9524-4220-a7fc-ab5606975fdb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94358) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 21 10:47:58.493669 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-05e62bfc-cf4c-486d-a771-97ce4349d3a3 tempest-ServersNegativeTestJSON-703029332 tempest-ServersNegativeTestJSON-703029332-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:47:58.494080 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-05e62bfc-cf4c-486d-a771-97ce4349d3a3 tempest-ServersNegativeTestJSON-703029332 tempest-ServersNegativeTestJSON-703029332-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:47:58.531892 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-05e62bfc-cf4c-486d-a771-97ce4349d3a3 tempest-ServersNegativeTestJSON-703029332 tempest-ServersNegativeTestJSON-703029332-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:47:58.533104 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-05e62bfc-cf4c-486d-a771-97ce4349d3a3 tempest-ServersNegativeTestJSON-703029332 tempest-ServersNegativeTestJSON-703029332-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:48:18.711147 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-c13dde0b-c2ed-48ce-a354-716b5d702a8d tempest-ServersNegativeTestJSON-703029332 tempest-ServersNegativeTestJSON-703029332-project] Took 0.42 seconds to select destinations for 1 instance(s). {{(pid=94357) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 21 10:48:18.747886 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-c13dde0b-c2ed-48ce-a354-716b5d702a8d tempest-ServersNegativeTestJSON-703029332 tempest-ServersNegativeTestJSON-703029332-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:48:18.748101 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-c13dde0b-c2ed-48ce-a354-716b5d702a8d tempest-ServersNegativeTestJSON-703029332 tempest-ServersNegativeTestJSON-703029332-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:48:18.858835 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-c13dde0b-c2ed-48ce-a354-716b5d702a8d tempest-ServersNegativeTestJSON-703029332 tempest-ServersNegativeTestJSON-703029332-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:48:18.859410 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-c13dde0b-c2ed-48ce-a354-716b5d702a8d tempest-ServersNegativeTestJSON-703029332 tempest-ServersNegativeTestJSON-703029332-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:48:18.860678 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-c13dde0b-c2ed-48ce-a354-716b5d702a8d tempest-ServersNegativeTestJSON-703029332 tempest-ServersNegativeTestJSON-703029332-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:48:18.862347 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-c13dde0b-c2ed-48ce-a354-716b5d702a8d tempest-ServersNegativeTestJSON-703029332 tempest-ServersNegativeTestJSON-703029332-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:48:18.929563 n-d-811414-3 nova-conductor[94357]: DEBUG nova.quota [None req-c13dde0b-c2ed-48ce-a354-716b5d702a8d tempest-ServersNegativeTestJSON-703029332 tempest-ServersNegativeTestJSON-703029332-project] Getting quotas for project e96f3c3693b04468af85382414cc5bf9. Resources: {'instances', 'cores', 'ram'} {{(pid=94357) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 21 10:48:18.944508 n-d-811414-3 nova-conductor[94357]: DEBUG nova.quota [None req-c13dde0b-c2ed-48ce-a354-716b5d702a8d tempest-ServersNegativeTestJSON-703029332 tempest-ServersNegativeTestJSON-703029332-project] Getting quotas for user a2c15cc9caef40ff89c96c0dca8aec26 and project e96f3c3693b04468af85382414cc5bf9. Resources: {'instances', 'cores', 'ram'} {{(pid=94357) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 21 10:48:18.966022 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-c13dde0b-c2ed-48ce-a354-716b5d702a8d tempest-ServersNegativeTestJSON-703029332 tempest-ServersNegativeTestJSON-703029332-project] [instance: d334f0f8-01dc-4807-918e-87ee364b2aed] Selected host: n-h2-811414-3; Selected node: n-h2-811414-3; Alternates: [('n-h1-811414-3', 'n-h1-811414-3')] {{(pid=94357) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 21 10:48:18.966975 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-c13dde0b-c2ed-48ce-a354-716b5d702a8d tempest-ServersNegativeTestJSON-703029332 tempest-ServersNegativeTestJSON-703029332-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:48:18.967387 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-c13dde0b-c2ed-48ce-a354-716b5d702a8d tempest-ServersNegativeTestJSON-703029332 tempest-ServersNegativeTestJSON-703029332-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:48:18.981733 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-c13dde0b-c2ed-48ce-a354-716b5d702a8d tempest-ServersNegativeTestJSON-703029332 tempest-ServersNegativeTestJSON-703029332-project] [instance: d334f0f8-01dc-4807-918e-87ee364b2aed] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f5cdc3d5-9524-4220-a7fc-ab5606975fdb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94357) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 21 10:48:18.983193 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-c13dde0b-c2ed-48ce-a354-716b5d702a8d tempest-ServersNegativeTestJSON-703029332 tempest-ServersNegativeTestJSON-703029332-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:48:18.983605 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-c13dde0b-c2ed-48ce-a354-716b5d702a8d tempest-ServersNegativeTestJSON-703029332 tempest-ServersNegativeTestJSON-703029332-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:48:19.043212 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-c13dde0b-c2ed-48ce-a354-716b5d702a8d tempest-ServersNegativeTestJSON-703029332 tempest-ServersNegativeTestJSON-703029332-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:48:19.043973 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-c13dde0b-c2ed-48ce-a354-716b5d702a8d tempest-ServersNegativeTestJSON-703029332 tempest-ServersNegativeTestJSON-703029332-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:48:28.197588 n-d-811414-3 nova-conductor[94357]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6404cb3a-bdc9-481c-93a6-d63501b53d9b] AMQP server on 10.222.0.13:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 21 10:48:29.206318 n-d-811414-3 nova-conductor[94357]: INFO oslo.messaging._drivers.impl_rabbit [-] [6404cb3a-bdc9-481c-93a6-d63501b53d9b] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 48350. Apr 21 10:48:33.552796 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-31383e6f-0949-40db-b0cc-381bf2727056 tempest-ImagesOneServerNegativeTestJSON-359199187 tempest-ImagesOneServerNegativeTestJSON-359199187-project] Took 0.73 seconds to select destinations for 1 instance(s). {{(pid=94358) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 21 10:48:33.599825 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-31383e6f-0949-40db-b0cc-381bf2727056 tempest-ImagesOneServerNegativeTestJSON-359199187 tempest-ImagesOneServerNegativeTestJSON-359199187-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:48:33.600235 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-31383e6f-0949-40db-b0cc-381bf2727056 tempest-ImagesOneServerNegativeTestJSON-359199187 tempest-ImagesOneServerNegativeTestJSON-359199187-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:48:33.694150 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-31383e6f-0949-40db-b0cc-381bf2727056 tempest-ImagesOneServerNegativeTestJSON-359199187 tempest-ImagesOneServerNegativeTestJSON-359199187-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:48:33.694562 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-31383e6f-0949-40db-b0cc-381bf2727056 tempest-ImagesOneServerNegativeTestJSON-359199187 tempest-ImagesOneServerNegativeTestJSON-359199187-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:48:33.695272 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-31383e6f-0949-40db-b0cc-381bf2727056 tempest-ImagesOneServerNegativeTestJSON-359199187 tempest-ImagesOneServerNegativeTestJSON-359199187-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:48:33.695658 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-31383e6f-0949-40db-b0cc-381bf2727056 tempest-ImagesOneServerNegativeTestJSON-359199187 tempest-ImagesOneServerNegativeTestJSON-359199187-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:48:33.738799 n-d-811414-3 nova-conductor[94358]: DEBUG nova.quota [None req-31383e6f-0949-40db-b0cc-381bf2727056 tempest-ImagesOneServerNegativeTestJSON-359199187 tempest-ImagesOneServerNegativeTestJSON-359199187-project] Getting quotas for project 6df93b3e352d426ba326ee59599bb7c4. Resources: {'instances', 'cores', 'ram'} {{(pid=94358) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 21 10:48:33.744008 n-d-811414-3 nova-conductor[94358]: DEBUG nova.quota [None req-31383e6f-0949-40db-b0cc-381bf2727056 tempest-ImagesOneServerNegativeTestJSON-359199187 tempest-ImagesOneServerNegativeTestJSON-359199187-project] Getting quotas for user 9df52c8bcea14106b61aecdea9d22793 and project 6df93b3e352d426ba326ee59599bb7c4. Resources: {'instances', 'cores', 'ram'} {{(pid=94358) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 21 10:48:33.764155 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-31383e6f-0949-40db-b0cc-381bf2727056 tempest-ImagesOneServerNegativeTestJSON-359199187 tempest-ImagesOneServerNegativeTestJSON-359199187-project] [instance: 33c7ab14-042e-40ad-865b-406f06e9eb22] Selected host: n-h2-811414-3; Selected node: n-h2-811414-3; Alternates: [('n-h1-811414-3', 'n-h1-811414-3')] {{(pid=94358) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 21 10:48:33.766061 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-31383e6f-0949-40db-b0cc-381bf2727056 tempest-ImagesOneServerNegativeTestJSON-359199187 tempest-ImagesOneServerNegativeTestJSON-359199187-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:48:33.766613 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-31383e6f-0949-40db-b0cc-381bf2727056 tempest-ImagesOneServerNegativeTestJSON-359199187 tempest-ImagesOneServerNegativeTestJSON-359199187-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:48:33.781984 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-31383e6f-0949-40db-b0cc-381bf2727056 tempest-ImagesOneServerNegativeTestJSON-359199187 tempest-ImagesOneServerNegativeTestJSON-359199187-project] [instance: 33c7ab14-042e-40ad-865b-406f06e9eb22] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f5cdc3d5-9524-4220-a7fc-ab5606975fdb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94358) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 21 10:48:33.783306 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-31383e6f-0949-40db-b0cc-381bf2727056 tempest-ImagesOneServerNegativeTestJSON-359199187 tempest-ImagesOneServerNegativeTestJSON-359199187-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:48:33.783666 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-31383e6f-0949-40db-b0cc-381bf2727056 tempest-ImagesOneServerNegativeTestJSON-359199187 tempest-ImagesOneServerNegativeTestJSON-359199187-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:48:33.840787 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-31383e6f-0949-40db-b0cc-381bf2727056 tempest-ImagesOneServerNegativeTestJSON-359199187 tempest-ImagesOneServerNegativeTestJSON-359199187-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:48:33.841197 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-31383e6f-0949-40db-b0cc-381bf2727056 tempest-ImagesOneServerNegativeTestJSON-359199187 tempest-ImagesOneServerNegativeTestJSON-359199187-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:48:46.758355 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-c128f7cc-6c7d-44a1-96f1-3b0d049063ac tempest-ServersTestMultiNic-1626207791 tempest-ServersTestMultiNic-1626207791-project] Took 0.47 seconds to select destinations for 1 instance(s). {{(pid=94357) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 21 10:48:46.790539 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-c128f7cc-6c7d-44a1-96f1-3b0d049063ac tempest-ServersTestMultiNic-1626207791 tempest-ServersTestMultiNic-1626207791-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:48:46.791211 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-c128f7cc-6c7d-44a1-96f1-3b0d049063ac tempest-ServersTestMultiNic-1626207791 tempest-ServersTestMultiNic-1626207791-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:48:46.874504 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-c128f7cc-6c7d-44a1-96f1-3b0d049063ac tempest-ServersTestMultiNic-1626207791 tempest-ServersTestMultiNic-1626207791-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:48:46.875204 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-c128f7cc-6c7d-44a1-96f1-3b0d049063ac tempest-ServersTestMultiNic-1626207791 tempest-ServersTestMultiNic-1626207791-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:48:46.876543 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-c128f7cc-6c7d-44a1-96f1-3b0d049063ac tempest-ServersTestMultiNic-1626207791 tempest-ServersTestMultiNic-1626207791-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:48:46.877108 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-c128f7cc-6c7d-44a1-96f1-3b0d049063ac tempest-ServersTestMultiNic-1626207791 tempest-ServersTestMultiNic-1626207791-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:48:46.902073 n-d-811414-3 nova-conductor[94357]: DEBUG nova.quota [None req-c128f7cc-6c7d-44a1-96f1-3b0d049063ac tempest-ServersTestMultiNic-1626207791 tempest-ServersTestMultiNic-1626207791-project] Getting quotas for project 70dbe5fa596f475ba43c1b35b5817a2a. Resources: {'instances', 'cores', 'ram'} {{(pid=94357) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 21 10:48:46.907996 n-d-811414-3 nova-conductor[94357]: DEBUG nova.quota [None req-c128f7cc-6c7d-44a1-96f1-3b0d049063ac tempest-ServersTestMultiNic-1626207791 tempest-ServersTestMultiNic-1626207791-project] Getting quotas for user 3ba26fc95ab24827ac60797cd84e1bc6 and project 70dbe5fa596f475ba43c1b35b5817a2a. Resources: {'instances', 'cores', 'ram'} {{(pid=94357) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 21 10:48:46.922927 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-c128f7cc-6c7d-44a1-96f1-3b0d049063ac tempest-ServersTestMultiNic-1626207791 tempest-ServersTestMultiNic-1626207791-project] [instance: 74f3a020-403a-40a3-a29b-1037e4c82dc2] Selected host: n-h2-811414-3; Selected node: n-h2-811414-3; Alternates: [('n-h1-811414-3', 'n-h1-811414-3')] {{(pid=94357) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 21 10:48:46.926568 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-c128f7cc-6c7d-44a1-96f1-3b0d049063ac tempest-ServersTestMultiNic-1626207791 tempest-ServersTestMultiNic-1626207791-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:48:46.927421 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-c128f7cc-6c7d-44a1-96f1-3b0d049063ac tempest-ServersTestMultiNic-1626207791 tempest-ServersTestMultiNic-1626207791-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:48:46.937449 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-c128f7cc-6c7d-44a1-96f1-3b0d049063ac tempest-ServersTestMultiNic-1626207791 tempest-ServersTestMultiNic-1626207791-project] [instance: 74f3a020-403a-40a3-a29b-1037e4c82dc2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f5cdc3d5-9524-4220-a7fc-ab5606975fdb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94357) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 21 10:48:46.939544 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-c128f7cc-6c7d-44a1-96f1-3b0d049063ac tempest-ServersTestMultiNic-1626207791 tempest-ServersTestMultiNic-1626207791-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:48:46.940437 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-c128f7cc-6c7d-44a1-96f1-3b0d049063ac tempest-ServersTestMultiNic-1626207791 tempest-ServersTestMultiNic-1626207791-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:48:46.988679 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-c128f7cc-6c7d-44a1-96f1-3b0d049063ac tempest-ServersTestMultiNic-1626207791 tempest-ServersTestMultiNic-1626207791-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:48:46.989181 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-c128f7cc-6c7d-44a1-96f1-3b0d049063ac tempest-ServersTestMultiNic-1626207791 tempest-ServersTestMultiNic-1626207791-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:48:50.926465 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-ff7244a5-1ca4-4579-86d0-a04f2a3848d8 tempest-DeleteServersTestJSON-192729269 tempest-DeleteServersTestJSON-192729269-project] Took 0.41 seconds to select destinations for 1 instance(s). {{(pid=94358) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 21 10:48:50.981399 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-ff7244a5-1ca4-4579-86d0-a04f2a3848d8 tempest-DeleteServersTestJSON-192729269 tempest-DeleteServersTestJSON-192729269-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:48:50.982850 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-ff7244a5-1ca4-4579-86d0-a04f2a3848d8 tempest-DeleteServersTestJSON-192729269 tempest-DeleteServersTestJSON-192729269-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:48:51.073230 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-ff7244a5-1ca4-4579-86d0-a04f2a3848d8 tempest-DeleteServersTestJSON-192729269 tempest-DeleteServersTestJSON-192729269-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:48:51.074566 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-ff7244a5-1ca4-4579-86d0-a04f2a3848d8 tempest-DeleteServersTestJSON-192729269 tempest-DeleteServersTestJSON-192729269-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:48:51.075863 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-ff7244a5-1ca4-4579-86d0-a04f2a3848d8 tempest-DeleteServersTestJSON-192729269 tempest-DeleteServersTestJSON-192729269-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:48:51.077241 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-ff7244a5-1ca4-4579-86d0-a04f2a3848d8 tempest-DeleteServersTestJSON-192729269 tempest-DeleteServersTestJSON-192729269-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:48:51.122239 n-d-811414-3 nova-conductor[94358]: DEBUG nova.quota [None req-ff7244a5-1ca4-4579-86d0-a04f2a3848d8 tempest-DeleteServersTestJSON-192729269 tempest-DeleteServersTestJSON-192729269-project] Getting quotas for project 37786f41cece448d819cedcc10899423. Resources: {'instances', 'cores', 'ram'} {{(pid=94358) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 21 10:48:51.130903 n-d-811414-3 nova-conductor[94358]: DEBUG nova.quota [None req-ff7244a5-1ca4-4579-86d0-a04f2a3848d8 tempest-DeleteServersTestJSON-192729269 tempest-DeleteServersTestJSON-192729269-project] Getting quotas for user 37fbf69bd6394006b1977bd1d651621f and project 37786f41cece448d819cedcc10899423. Resources: {'instances', 'cores', 'ram'} {{(pid=94358) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 21 10:48:51.185485 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-ff7244a5-1ca4-4579-86d0-a04f2a3848d8 tempest-DeleteServersTestJSON-192729269 tempest-DeleteServersTestJSON-192729269-project] [instance: 222c1463-7e6c-4128-98ba-37cb2daba062] Selected host: n-h2-811414-3; Selected node: n-h2-811414-3; Alternates: [('n-h1-811414-3', 'n-h1-811414-3')] {{(pid=94358) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 21 10:48:51.188825 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-ff7244a5-1ca4-4579-86d0-a04f2a3848d8 tempest-DeleteServersTestJSON-192729269 tempest-DeleteServersTestJSON-192729269-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:48:51.189307 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-ff7244a5-1ca4-4579-86d0-a04f2a3848d8 tempest-DeleteServersTestJSON-192729269 tempest-DeleteServersTestJSON-192729269-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:48:51.228074 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-ff7244a5-1ca4-4579-86d0-a04f2a3848d8 tempest-DeleteServersTestJSON-192729269 tempest-DeleteServersTestJSON-192729269-project] [instance: 222c1463-7e6c-4128-98ba-37cb2daba062] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f5cdc3d5-9524-4220-a7fc-ab5606975fdb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94358) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 21 10:48:51.234622 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-ff7244a5-1ca4-4579-86d0-a04f2a3848d8 tempest-DeleteServersTestJSON-192729269 tempest-DeleteServersTestJSON-192729269-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:48:51.239855 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-ff7244a5-1ca4-4579-86d0-a04f2a3848d8 tempest-DeleteServersTestJSON-192729269 tempest-DeleteServersTestJSON-192729269-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:48:51.364940 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-ff7244a5-1ca4-4579-86d0-a04f2a3848d8 tempest-DeleteServersTestJSON-192729269 tempest-DeleteServersTestJSON-192729269-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:48:51.365535 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-ff7244a5-1ca4-4579-86d0-a04f2a3848d8 tempest-DeleteServersTestJSON-192729269 tempest-DeleteServersTestJSON-192729269-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:48:58.135391 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-50be14b1-5cf5-422a-8df5-76ac59899d9c tempest-ServerDiskConfigTestJSON-900499457 tempest-ServerDiskConfigTestJSON-900499457-project] Took 0.40 seconds to select destinations for 1 instance(s). {{(pid=94357) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 21 10:48:58.185288 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-50be14b1-5cf5-422a-8df5-76ac59899d9c tempest-ServerDiskConfigTestJSON-900499457 tempest-ServerDiskConfigTestJSON-900499457-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:48:58.186131 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-50be14b1-5cf5-422a-8df5-76ac59899d9c tempest-ServerDiskConfigTestJSON-900499457 tempest-ServerDiskConfigTestJSON-900499457-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:48:58.264367 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-50be14b1-5cf5-422a-8df5-76ac59899d9c tempest-ServerDiskConfigTestJSON-900499457 tempest-ServerDiskConfigTestJSON-900499457-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:48:58.264897 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-50be14b1-5cf5-422a-8df5-76ac59899d9c tempest-ServerDiskConfigTestJSON-900499457 tempest-ServerDiskConfigTestJSON-900499457-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:48:58.266354 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-50be14b1-5cf5-422a-8df5-76ac59899d9c tempest-ServerDiskConfigTestJSON-900499457 tempest-ServerDiskConfigTestJSON-900499457-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:48:58.270891 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-50be14b1-5cf5-422a-8df5-76ac59899d9c tempest-ServerDiskConfigTestJSON-900499457 tempest-ServerDiskConfigTestJSON-900499457-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:48:58.293419 n-d-811414-3 nova-conductor[94357]: DEBUG nova.quota [None req-50be14b1-5cf5-422a-8df5-76ac59899d9c tempest-ServerDiskConfigTestJSON-900499457 tempest-ServerDiskConfigTestJSON-900499457-project] Getting quotas for project 78a902223fa5427fa8674f3c72f167d5. Resources: {'instances', 'cores', 'ram'} {{(pid=94357) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 21 10:48:58.298128 n-d-811414-3 nova-conductor[94357]: DEBUG nova.quota [None req-50be14b1-5cf5-422a-8df5-76ac59899d9c tempest-ServerDiskConfigTestJSON-900499457 tempest-ServerDiskConfigTestJSON-900499457-project] Getting quotas for user 7e648cbf76134a7cb08ed2747dfcf7c3 and project 78a902223fa5427fa8674f3c72f167d5. Resources: {'instances', 'cores', 'ram'} {{(pid=94357) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 21 10:48:58.310667 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-50be14b1-5cf5-422a-8df5-76ac59899d9c tempest-ServerDiskConfigTestJSON-900499457 tempest-ServerDiskConfigTestJSON-900499457-project] [instance: b102ee4d-50d8-44c7-beb1-f38c334222b3] Selected host: n-h2-811414-3; Selected node: n-h2-811414-3; Alternates: [('n-h1-811414-3', 'n-h1-811414-3')] {{(pid=94357) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 21 10:48:58.311862 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-50be14b1-5cf5-422a-8df5-76ac59899d9c tempest-ServerDiskConfigTestJSON-900499457 tempest-ServerDiskConfigTestJSON-900499457-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:48:58.312578 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-50be14b1-5cf5-422a-8df5-76ac59899d9c tempest-ServerDiskConfigTestJSON-900499457 tempest-ServerDiskConfigTestJSON-900499457-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:48:58.325150 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-50be14b1-5cf5-422a-8df5-76ac59899d9c tempest-ServerDiskConfigTestJSON-900499457 tempest-ServerDiskConfigTestJSON-900499457-project] [instance: b102ee4d-50d8-44c7-beb1-f38c334222b3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f5cdc3d5-9524-4220-a7fc-ab5606975fdb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94357) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 21 10:48:58.331472 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-50be14b1-5cf5-422a-8df5-76ac59899d9c tempest-ServerDiskConfigTestJSON-900499457 tempest-ServerDiskConfigTestJSON-900499457-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:48:58.332478 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-50be14b1-5cf5-422a-8df5-76ac59899d9c tempest-ServerDiskConfigTestJSON-900499457 tempest-ServerDiskConfigTestJSON-900499457-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:48:58.383721 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-50be14b1-5cf5-422a-8df5-76ac59899d9c tempest-ServerDiskConfigTestJSON-900499457 tempest-ServerDiskConfigTestJSON-900499457-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:48:58.384915 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-50be14b1-5cf5-422a-8df5-76ac59899d9c tempest-ServerDiskConfigTestJSON-900499457 tempest-ServerDiskConfigTestJSON-900499457-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:49:12.923477 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-7bc60557-4bc4-483a-8951-12fec42906a2 tempest-ServersOnMultiNodesTest-174179125 tempest-ServersOnMultiNodesTest-174179125-project] Took 0.52 seconds to select destinations for 1 instance(s). {{(pid=94358) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 21 10:49:12.993345 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-7bc60557-4bc4-483a-8951-12fec42906a2 tempest-ServersOnMultiNodesTest-174179125 tempest-ServersOnMultiNodesTest-174179125-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:49:12.993783 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-7bc60557-4bc4-483a-8951-12fec42906a2 tempest-ServersOnMultiNodesTest-174179125 tempest-ServersOnMultiNodesTest-174179125-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:49:13.107844 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-7bc60557-4bc4-483a-8951-12fec42906a2 tempest-ServersOnMultiNodesTest-174179125 tempest-ServersOnMultiNodesTest-174179125-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:49:13.107844 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-7bc60557-4bc4-483a-8951-12fec42906a2 tempest-ServersOnMultiNodesTest-174179125 tempest-ServersOnMultiNodesTest-174179125-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:49:13.108288 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-7bc60557-4bc4-483a-8951-12fec42906a2 tempest-ServersOnMultiNodesTest-174179125 tempest-ServersOnMultiNodesTest-174179125-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:49:13.108860 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-7bc60557-4bc4-483a-8951-12fec42906a2 tempest-ServersOnMultiNodesTest-174179125 tempest-ServersOnMultiNodesTest-174179125-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:49:13.136476 n-d-811414-3 nova-conductor[94358]: DEBUG nova.quota [None req-7bc60557-4bc4-483a-8951-12fec42906a2 tempest-ServersOnMultiNodesTest-174179125 tempest-ServersOnMultiNodesTest-174179125-project] Getting quotas for project 2430b168754442d1b4fdbcfa80bfaccd. Resources: {'instances', 'cores', 'ram'} {{(pid=94358) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 21 10:49:13.145148 n-d-811414-3 nova-conductor[94358]: DEBUG nova.quota [None req-7bc60557-4bc4-483a-8951-12fec42906a2 tempest-ServersOnMultiNodesTest-174179125 tempest-ServersOnMultiNodesTest-174179125-project] Getting quotas for user 831e8270c33b4193b8d2d4ae2098f5da and project 2430b168754442d1b4fdbcfa80bfaccd. Resources: {'instances', 'cores', 'ram'} {{(pid=94358) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 21 10:49:13.165976 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-7bc60557-4bc4-483a-8951-12fec42906a2 tempest-ServersOnMultiNodesTest-174179125 tempest-ServersOnMultiNodesTest-174179125-project] [instance: 6bf625af-8aca-4d9d-8444-e1936610e78b] Selected host: n-h2-811414-3; Selected node: n-h2-811414-3; Alternates: [('n-h1-811414-3', 'n-h1-811414-3')] {{(pid=94358) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 21 10:49:13.167057 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-7bc60557-4bc4-483a-8951-12fec42906a2 tempest-ServersOnMultiNodesTest-174179125 tempest-ServersOnMultiNodesTest-174179125-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:49:13.175324 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-7bc60557-4bc4-483a-8951-12fec42906a2 tempest-ServersOnMultiNodesTest-174179125 tempest-ServersOnMultiNodesTest-174179125-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:49:13.191087 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-7bc60557-4bc4-483a-8951-12fec42906a2 tempest-ServersOnMultiNodesTest-174179125 tempest-ServersOnMultiNodesTest-174179125-project] [instance: 6bf625af-8aca-4d9d-8444-e1936610e78b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f5cdc3d5-9524-4220-a7fc-ab5606975fdb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94358) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 21 10:49:13.193037 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-7bc60557-4bc4-483a-8951-12fec42906a2 tempest-ServersOnMultiNodesTest-174179125 tempest-ServersOnMultiNodesTest-174179125-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:49:13.193556 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-7bc60557-4bc4-483a-8951-12fec42906a2 tempest-ServersOnMultiNodesTest-174179125 tempest-ServersOnMultiNodesTest-174179125-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:49:13.249865 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-7bc60557-4bc4-483a-8951-12fec42906a2 tempest-ServersOnMultiNodesTest-174179125 tempest-ServersOnMultiNodesTest-174179125-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:49:13.250474 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-7bc60557-4bc4-483a-8951-12fec42906a2 tempest-ServersOnMultiNodesTest-174179125 tempest-ServersOnMultiNodesTest-174179125-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:49:20.387976 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-5746c319-dd15-402b-bcf9-6c7ba0cafc53 tempest-ServerDiskConfigTestJSON-900499457 tempest-ServerDiskConfigTestJSON-900499457-project] Targeting cell 6c99d8ec-fb48-48af-b02b-a629a7c2cb6b(cell1) for conductor method rebuild_instance {{(pid=94357) wrapper /opt/stack/nova/nova/conductor/manager.py:91}} Apr 21 10:49:20.388582 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-5746c319-dd15-402b-bcf9-6c7ba0cafc53 tempest-ServerDiskConfigTestJSON-900499457 tempest-ServerDiskConfigTestJSON-900499457-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:49:20.388893 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-5746c319-dd15-402b-bcf9-6c7ba0cafc53 tempest-ServerDiskConfigTestJSON-900499457 tempest-ServerDiskConfigTestJSON-900499457-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:49:20.423383 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-5746c319-dd15-402b-bcf9-6c7ba0cafc53 tempest-ServerDiskConfigTestJSON-900499457 tempest-ServerDiskConfigTestJSON-900499457-project] [instance: b102ee4d-50d8-44c7-beb1-f38c334222b3] No migration record for the rebuild/evacuate request. {{(pid=94357) rebuild_instance /opt/stack/nova/nova/conductor/manager.py:1101}} Apr 21 10:49:27.578166 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-a2bdaa8c-297f-4a0e-ab9b-bf76e27127d3 tempest-ServerRescueTestJSONUnderV235-1421801324 tempest-ServerRescueTestJSONUnderV235-1421801324-project] Took 0.43 seconds to select destinations for 1 instance(s). {{(pid=94358) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 21 10:49:27.645656 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-a2bdaa8c-297f-4a0e-ab9b-bf76e27127d3 tempest-ServerRescueTestJSONUnderV235-1421801324 tempest-ServerRescueTestJSONUnderV235-1421801324-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:49:27.648208 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-a2bdaa8c-297f-4a0e-ab9b-bf76e27127d3 tempest-ServerRescueTestJSONUnderV235-1421801324 tempest-ServerRescueTestJSONUnderV235-1421801324-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:49:27.753577 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-a2bdaa8c-297f-4a0e-ab9b-bf76e27127d3 tempest-ServerRescueTestJSONUnderV235-1421801324 tempest-ServerRescueTestJSONUnderV235-1421801324-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:49:27.753907 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-a2bdaa8c-297f-4a0e-ab9b-bf76e27127d3 tempest-ServerRescueTestJSONUnderV235-1421801324 tempest-ServerRescueTestJSONUnderV235-1421801324-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:49:27.756119 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-a2bdaa8c-297f-4a0e-ab9b-bf76e27127d3 tempest-ServerRescueTestJSONUnderV235-1421801324 tempest-ServerRescueTestJSONUnderV235-1421801324-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:49:27.758658 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-a2bdaa8c-297f-4a0e-ab9b-bf76e27127d3 tempest-ServerRescueTestJSONUnderV235-1421801324 tempest-ServerRescueTestJSONUnderV235-1421801324-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:49:27.798890 n-d-811414-3 nova-conductor[94358]: DEBUG nova.quota [None req-a2bdaa8c-297f-4a0e-ab9b-bf76e27127d3 tempest-ServerRescueTestJSONUnderV235-1421801324 tempest-ServerRescueTestJSONUnderV235-1421801324-project] Getting quotas for project 0b6a7d87f85349739069341afc416652. Resources: {'instances', 'cores', 'ram'} {{(pid=94358) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 21 10:49:27.811108 n-d-811414-3 nova-conductor[94358]: DEBUG nova.quota [None req-a2bdaa8c-297f-4a0e-ab9b-bf76e27127d3 tempest-ServerRescueTestJSONUnderV235-1421801324 tempest-ServerRescueTestJSONUnderV235-1421801324-project] Getting quotas for user 6e9aaec5138a4ffd8f7585acf4f72969 and project 0b6a7d87f85349739069341afc416652. Resources: {'instances', 'cores', 'ram'} {{(pid=94358) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 21 10:49:27.838037 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-a2bdaa8c-297f-4a0e-ab9b-bf76e27127d3 tempest-ServerRescueTestJSONUnderV235-1421801324 tempest-ServerRescueTestJSONUnderV235-1421801324-project] [instance: 29285126-aae5-4f66-ba5c-afd6b88947c9] Selected host: n-h2-811414-3; Selected node: n-h2-811414-3; Alternates: [('n-h1-811414-3', 'n-h1-811414-3')] {{(pid=94358) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 21 10:49:27.838997 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-a2bdaa8c-297f-4a0e-ab9b-bf76e27127d3 tempest-ServerRescueTestJSONUnderV235-1421801324 tempest-ServerRescueTestJSONUnderV235-1421801324-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:49:27.839404 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-a2bdaa8c-297f-4a0e-ab9b-bf76e27127d3 tempest-ServerRescueTestJSONUnderV235-1421801324 tempest-ServerRescueTestJSONUnderV235-1421801324-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:49:27.853345 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-a2bdaa8c-297f-4a0e-ab9b-bf76e27127d3 tempest-ServerRescueTestJSONUnderV235-1421801324 tempest-ServerRescueTestJSONUnderV235-1421801324-project] [instance: 29285126-aae5-4f66-ba5c-afd6b88947c9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f5cdc3d5-9524-4220-a7fc-ab5606975fdb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94358) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 21 10:49:27.854761 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-a2bdaa8c-297f-4a0e-ab9b-bf76e27127d3 tempest-ServerRescueTestJSONUnderV235-1421801324 tempest-ServerRescueTestJSONUnderV235-1421801324-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:49:27.855295 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-a2bdaa8c-297f-4a0e-ab9b-bf76e27127d3 tempest-ServerRescueTestJSONUnderV235-1421801324 tempest-ServerRescueTestJSONUnderV235-1421801324-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:49:27.919846 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-a2bdaa8c-297f-4a0e-ab9b-bf76e27127d3 tempest-ServerRescueTestJSONUnderV235-1421801324 tempest-ServerRescueTestJSONUnderV235-1421801324-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:49:27.920262 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-a2bdaa8c-297f-4a0e-ab9b-bf76e27127d3 tempest-ServerRescueTestJSONUnderV235-1421801324 tempest-ServerRescueTestJSONUnderV235-1421801324-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:49:35.029612 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-5b4d9b7e-9049-4559-9210-8ce70dd55e2b tempest-ServersOnMultiNodesTest-174179125 tempest-ServersOnMultiNodesTest-174179125-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:49:35.030172 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-5b4d9b7e-9049-4559-9210-8ce70dd55e2b tempest-ServersOnMultiNodesTest-174179125 tempest-ServersOnMultiNodesTest-174179125-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:49:35.653562 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-5b4d9b7e-9049-4559-9210-8ce70dd55e2b tempest-ServersOnMultiNodesTest-174179125 tempest-ServersOnMultiNodesTest-174179125-project] Took 0.53 seconds to select destinations for 2 instance(s). {{(pid=94357) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 21 10:49:35.709535 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-5b4d9b7e-9049-4559-9210-8ce70dd55e2b tempest-ServersOnMultiNodesTest-174179125 tempest-ServersOnMultiNodesTest-174179125-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:49:35.709959 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-5b4d9b7e-9049-4559-9210-8ce70dd55e2b tempest-ServersOnMultiNodesTest-174179125 tempest-ServersOnMultiNodesTest-174179125-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:49:35.769697 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-5b4d9b7e-9049-4559-9210-8ce70dd55e2b tempest-ServersOnMultiNodesTest-174179125 tempest-ServersOnMultiNodesTest-174179125-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:49:35.770458 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-5b4d9b7e-9049-4559-9210-8ce70dd55e2b tempest-ServersOnMultiNodesTest-174179125 tempest-ServersOnMultiNodesTest-174179125-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:49:35.830178 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-5b4d9b7e-9049-4559-9210-8ce70dd55e2b tempest-ServersOnMultiNodesTest-174179125 tempest-ServersOnMultiNodesTest-174179125-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:49:35.830427 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-5b4d9b7e-9049-4559-9210-8ce70dd55e2b tempest-ServersOnMultiNodesTest-174179125 tempest-ServersOnMultiNodesTest-174179125-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:49:35.831823 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-5b4d9b7e-9049-4559-9210-8ce70dd55e2b tempest-ServersOnMultiNodesTest-174179125 tempest-ServersOnMultiNodesTest-174179125-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:49:35.832462 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-5b4d9b7e-9049-4559-9210-8ce70dd55e2b tempest-ServersOnMultiNodesTest-174179125 tempest-ServersOnMultiNodesTest-174179125-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:49:35.858668 n-d-811414-3 nova-conductor[94357]: DEBUG nova.quota [None req-5b4d9b7e-9049-4559-9210-8ce70dd55e2b tempest-ServersOnMultiNodesTest-174179125 tempest-ServersOnMultiNodesTest-174179125-project] Getting quotas for project 2430b168754442d1b4fdbcfa80bfaccd. Resources: {'instances', 'cores', 'ram'} {{(pid=94357) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 21 10:49:35.865917 n-d-811414-3 nova-conductor[94357]: DEBUG nova.quota [None req-5b4d9b7e-9049-4559-9210-8ce70dd55e2b tempest-ServersOnMultiNodesTest-174179125 tempest-ServersOnMultiNodesTest-174179125-project] Getting quotas for user 831e8270c33b4193b8d2d4ae2098f5da and project 2430b168754442d1b4fdbcfa80bfaccd. Resources: {'instances', 'cores', 'ram'} {{(pid=94357) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 21 10:49:35.879635 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-5b4d9b7e-9049-4559-9210-8ce70dd55e2b tempest-ServersOnMultiNodesTest-174179125 tempest-ServersOnMultiNodesTest-174179125-project] [instance: 65969c40-afcb-4954-8b54-68e4d2f6ec9a] Selected host: n-h2-811414-3; Selected node: n-h2-811414-3; Alternates: [] {{(pid=94357) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 21 10:49:35.881166 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-5b4d9b7e-9049-4559-9210-8ce70dd55e2b tempest-ServersOnMultiNodesTest-174179125 tempest-ServersOnMultiNodesTest-174179125-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:49:35.881519 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-5b4d9b7e-9049-4559-9210-8ce70dd55e2b tempest-ServersOnMultiNodesTest-174179125 tempest-ServersOnMultiNodesTest-174179125-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:49:35.890349 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-5b4d9b7e-9049-4559-9210-8ce70dd55e2b tempest-ServersOnMultiNodesTest-174179125 tempest-ServersOnMultiNodesTest-174179125-project] [instance: 65969c40-afcb-4954-8b54-68e4d2f6ec9a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f5cdc3d5-9524-4220-a7fc-ab5606975fdb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94357) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 21 10:49:35.891575 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-5b4d9b7e-9049-4559-9210-8ce70dd55e2b tempest-ServersOnMultiNodesTest-174179125 tempest-ServersOnMultiNodesTest-174179125-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:49:35.892949 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-5b4d9b7e-9049-4559-9210-8ce70dd55e2b tempest-ServersOnMultiNodesTest-174179125 tempest-ServersOnMultiNodesTest-174179125-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:49:35.933097 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-5b4d9b7e-9049-4559-9210-8ce70dd55e2b tempest-ServersOnMultiNodesTest-174179125 tempest-ServersOnMultiNodesTest-174179125-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:49:35.933639 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-5b4d9b7e-9049-4559-9210-8ce70dd55e2b tempest-ServersOnMultiNodesTest-174179125 tempest-ServersOnMultiNodesTest-174179125-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:49:35.949559 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-5b4d9b7e-9049-4559-9210-8ce70dd55e2b tempest-ServersOnMultiNodesTest-174179125 tempest-ServersOnMultiNodesTest-174179125-project] [instance: 5b6f048d-7ede-45d3-a153-769bf875ba7f] Selected host: n-h2-811414-3; Selected node: n-h2-811414-3; Alternates: [] {{(pid=94357) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 21 10:49:35.950391 n-d-811414-3 nova-conductor[94357]: DEBUG nova.objects.instance_group [None req-5b4d9b7e-9049-4559-9210-8ce70dd55e2b tempest-ServersOnMultiNodesTest-174179125 tempest-ServersOnMultiNodesTest-174179125-project] Lazy-loading 'hosts' on InstanceGroup uuid d41d1ebe-3583-4e76-b6ef-c526c88e0241 {{(pid=94357) obj_load_attr /opt/stack/nova/nova/objects/instance_group.py:357}} Apr 21 10:49:35.992584 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-5b4d9b7e-9049-4559-9210-8ce70dd55e2b tempest-ServersOnMultiNodesTest-174179125 tempest-ServersOnMultiNodesTest-174179125-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:49:35.993072 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-5b4d9b7e-9049-4559-9210-8ce70dd55e2b tempest-ServersOnMultiNodesTest-174179125 tempest-ServersOnMultiNodesTest-174179125-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:49:36.003972 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-5b4d9b7e-9049-4559-9210-8ce70dd55e2b tempest-ServersOnMultiNodesTest-174179125 tempest-ServersOnMultiNodesTest-174179125-project] [instance: 5b6f048d-7ede-45d3-a153-769bf875ba7f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f5cdc3d5-9524-4220-a7fc-ab5606975fdb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94357) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 21 10:49:36.007329 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-5b4d9b7e-9049-4559-9210-8ce70dd55e2b tempest-ServersOnMultiNodesTest-174179125 tempest-ServersOnMultiNodesTest-174179125-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:49:36.008413 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-5b4d9b7e-9049-4559-9210-8ce70dd55e2b tempest-ServersOnMultiNodesTest-174179125 tempest-ServersOnMultiNodesTest-174179125-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:49:36.128479 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-5b4d9b7e-9049-4559-9210-8ce70dd55e2b tempest-ServersOnMultiNodesTest-174179125 tempest-ServersOnMultiNodesTest-174179125-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:49:36.129604 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-5b4d9b7e-9049-4559-9210-8ce70dd55e2b tempest-ServersOnMultiNodesTest-174179125 tempest-ServersOnMultiNodesTest-174179125-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:49:57.839624 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-b641e954-d495-4c7c-ad22-061682935e6a tempest-ServersTestMultiNic-1626207791 tempest-ServersTestMultiNic-1626207791-project] Took 0.26 seconds to select destinations for 1 instance(s). {{(pid=94358) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 21 10:49:57.893948 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-b641e954-d495-4c7c-ad22-061682935e6a tempest-ServersTestMultiNic-1626207791 tempest-ServersTestMultiNic-1626207791-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:49:57.897158 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-b641e954-d495-4c7c-ad22-061682935e6a tempest-ServersTestMultiNic-1626207791 tempest-ServersTestMultiNic-1626207791-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:49:57.974319 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-b641e954-d495-4c7c-ad22-061682935e6a tempest-ServersTestMultiNic-1626207791 tempest-ServersTestMultiNic-1626207791-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:49:57.975161 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-b641e954-d495-4c7c-ad22-061682935e6a tempest-ServersTestMultiNic-1626207791 tempest-ServersTestMultiNic-1626207791-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:49:57.977407 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-b641e954-d495-4c7c-ad22-061682935e6a tempest-ServersTestMultiNic-1626207791 tempest-ServersTestMultiNic-1626207791-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:49:57.978179 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-b641e954-d495-4c7c-ad22-061682935e6a tempest-ServersTestMultiNic-1626207791 tempest-ServersTestMultiNic-1626207791-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:49:58.006918 n-d-811414-3 nova-conductor[94358]: DEBUG nova.quota [None req-b641e954-d495-4c7c-ad22-061682935e6a tempest-ServersTestMultiNic-1626207791 tempest-ServersTestMultiNic-1626207791-project] Getting quotas for project 70dbe5fa596f475ba43c1b35b5817a2a. Resources: {'instances', 'cores', 'ram'} {{(pid=94358) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 21 10:49:58.014675 n-d-811414-3 nova-conductor[94358]: DEBUG nova.quota [None req-b641e954-d495-4c7c-ad22-061682935e6a tempest-ServersTestMultiNic-1626207791 tempest-ServersTestMultiNic-1626207791-project] Getting quotas for user 3ba26fc95ab24827ac60797cd84e1bc6 and project 70dbe5fa596f475ba43c1b35b5817a2a. Resources: {'instances', 'cores', 'ram'} {{(pid=94358) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 21 10:49:58.052323 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-b641e954-d495-4c7c-ad22-061682935e6a tempest-ServersTestMultiNic-1626207791 tempest-ServersTestMultiNic-1626207791-project] [instance: cc5b46fc-8e9b-443d-abe6-67262a06ab6c] Selected host: n-h2-811414-3; Selected node: n-h2-811414-3; Alternates: [('n-h1-811414-3', 'n-h1-811414-3')] {{(pid=94358) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 21 10:49:58.053576 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-b641e954-d495-4c7c-ad22-061682935e6a tempest-ServersTestMultiNic-1626207791 tempest-ServersTestMultiNic-1626207791-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:49:58.054168 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-b641e954-d495-4c7c-ad22-061682935e6a tempest-ServersTestMultiNic-1626207791 tempest-ServersTestMultiNic-1626207791-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:49:58.070226 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-b641e954-d495-4c7c-ad22-061682935e6a tempest-ServersTestMultiNic-1626207791 tempest-ServersTestMultiNic-1626207791-project] [instance: cc5b46fc-8e9b-443d-abe6-67262a06ab6c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f5cdc3d5-9524-4220-a7fc-ab5606975fdb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94358) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 21 10:49:58.072432 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-b641e954-d495-4c7c-ad22-061682935e6a tempest-ServersTestMultiNic-1626207791 tempest-ServersTestMultiNic-1626207791-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:49:58.073001 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-b641e954-d495-4c7c-ad22-061682935e6a tempest-ServersTestMultiNic-1626207791 tempest-ServersTestMultiNic-1626207791-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:49:58.126728 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-b641e954-d495-4c7c-ad22-061682935e6a tempest-ServersTestMultiNic-1626207791 tempest-ServersTestMultiNic-1626207791-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:49:58.130097 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-b641e954-d495-4c7c-ad22-061682935e6a tempest-ServersTestMultiNic-1626207791 tempest-ServersTestMultiNic-1626207791-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:49:58.842791 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-755d0549-3887-4620-a0c1-bf30cd8ad933 tempest-ListServersNegativeTestJSON-1963586981 tempest-ListServersNegativeTestJSON-1963586981-project] Took 0.63 seconds to select destinations for 3 instance(s). {{(pid=94357) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 21 10:49:58.870232 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-755d0549-3887-4620-a0c1-bf30cd8ad933 tempest-ListServersNegativeTestJSON-1963586981 tempest-ListServersNegativeTestJSON-1963586981-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:49:58.870833 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-755d0549-3887-4620-a0c1-bf30cd8ad933 tempest-ListServersNegativeTestJSON-1963586981 tempest-ListServersNegativeTestJSON-1963586981-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:49:58.996887 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-755d0549-3887-4620-a0c1-bf30cd8ad933 tempest-ListServersNegativeTestJSON-1963586981 tempest-ListServersNegativeTestJSON-1963586981-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:49:58.997548 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-755d0549-3887-4620-a0c1-bf30cd8ad933 tempest-ListServersNegativeTestJSON-1963586981 tempest-ListServersNegativeTestJSON-1963586981-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:49:59.078033 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-755d0549-3887-4620-a0c1-bf30cd8ad933 tempest-ListServersNegativeTestJSON-1963586981 tempest-ListServersNegativeTestJSON-1963586981-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:49:59.078444 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-755d0549-3887-4620-a0c1-bf30cd8ad933 tempest-ListServersNegativeTestJSON-1963586981 tempest-ListServersNegativeTestJSON-1963586981-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:49:59.154339 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-755d0549-3887-4620-a0c1-bf30cd8ad933 tempest-ListServersNegativeTestJSON-1963586981 tempest-ListServersNegativeTestJSON-1963586981-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:49:59.154953 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-755d0549-3887-4620-a0c1-bf30cd8ad933 tempest-ListServersNegativeTestJSON-1963586981 tempest-ListServersNegativeTestJSON-1963586981-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:49:59.155857 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-755d0549-3887-4620-a0c1-bf30cd8ad933 tempest-ListServersNegativeTestJSON-1963586981 tempest-ListServersNegativeTestJSON-1963586981-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:49:59.156487 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-755d0549-3887-4620-a0c1-bf30cd8ad933 tempest-ListServersNegativeTestJSON-1963586981 tempest-ListServersNegativeTestJSON-1963586981-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:49:59.205539 n-d-811414-3 nova-conductor[94357]: DEBUG nova.quota [None req-755d0549-3887-4620-a0c1-bf30cd8ad933 tempest-ListServersNegativeTestJSON-1963586981 tempest-ListServersNegativeTestJSON-1963586981-project] Getting quotas for project 01a6939699304e6f95f1f7cb03a2ab22. Resources: {'instances', 'cores', 'ram'} {{(pid=94357) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 21 10:49:59.211331 n-d-811414-3 nova-conductor[94357]: DEBUG nova.quota [None req-755d0549-3887-4620-a0c1-bf30cd8ad933 tempest-ListServersNegativeTestJSON-1963586981 tempest-ListServersNegativeTestJSON-1963586981-project] Getting quotas for user e69d6bf42bf5415085e38821c4301c58 and project 01a6939699304e6f95f1f7cb03a2ab22. Resources: {'instances', 'cores', 'ram'} {{(pid=94357) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 21 10:49:59.257062 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-755d0549-3887-4620-a0c1-bf30cd8ad933 tempest-ListServersNegativeTestJSON-1963586981 tempest-ListServersNegativeTestJSON-1963586981-project] [instance: 09e360d9-7c4c-4870-b9fb-b1e5b6d2623a] Selected host: n-h2-811414-3; Selected node: n-h2-811414-3; Alternates: [('n-h1-811414-3', 'n-h1-811414-3')] {{(pid=94357) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 21 10:49:59.258222 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-755d0549-3887-4620-a0c1-bf30cd8ad933 tempest-ListServersNegativeTestJSON-1963586981 tempest-ListServersNegativeTestJSON-1963586981-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:49:59.258802 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-755d0549-3887-4620-a0c1-bf30cd8ad933 tempest-ListServersNegativeTestJSON-1963586981 tempest-ListServersNegativeTestJSON-1963586981-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:49:59.277037 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-755d0549-3887-4620-a0c1-bf30cd8ad933 tempest-ListServersNegativeTestJSON-1963586981 tempest-ListServersNegativeTestJSON-1963586981-project] [instance: 09e360d9-7c4c-4870-b9fb-b1e5b6d2623a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f5cdc3d5-9524-4220-a7fc-ab5606975fdb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94357) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 21 10:49:59.278844 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-755d0549-3887-4620-a0c1-bf30cd8ad933 tempest-ListServersNegativeTestJSON-1963586981 tempest-ListServersNegativeTestJSON-1963586981-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:49:59.279528 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-755d0549-3887-4620-a0c1-bf30cd8ad933 tempest-ListServersNegativeTestJSON-1963586981 tempest-ListServersNegativeTestJSON-1963586981-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:49:59.345577 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-755d0549-3887-4620-a0c1-bf30cd8ad933 tempest-ListServersNegativeTestJSON-1963586981 tempest-ListServersNegativeTestJSON-1963586981-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:49:59.346345 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-755d0549-3887-4620-a0c1-bf30cd8ad933 tempest-ListServersNegativeTestJSON-1963586981 tempest-ListServersNegativeTestJSON-1963586981-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:49:59.358858 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-755d0549-3887-4620-a0c1-bf30cd8ad933 tempest-ListServersNegativeTestJSON-1963586981 tempest-ListServersNegativeTestJSON-1963586981-project] [instance: 90e9c74c-2f66-4433-acc9-7f17cc01898d] Selected host: n-h2-811414-3; Selected node: n-h2-811414-3; Alternates: [('n-h1-811414-3', 'n-h1-811414-3')] {{(pid=94357) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 21 10:49:59.361528 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-755d0549-3887-4620-a0c1-bf30cd8ad933 tempest-ListServersNegativeTestJSON-1963586981 tempest-ListServersNegativeTestJSON-1963586981-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:49:59.362095 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-755d0549-3887-4620-a0c1-bf30cd8ad933 tempest-ListServersNegativeTestJSON-1963586981 tempest-ListServersNegativeTestJSON-1963586981-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:49:59.373853 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-755d0549-3887-4620-a0c1-bf30cd8ad933 tempest-ListServersNegativeTestJSON-1963586981 tempest-ListServersNegativeTestJSON-1963586981-project] [instance: 90e9c74c-2f66-4433-acc9-7f17cc01898d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f5cdc3d5-9524-4220-a7fc-ab5606975fdb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94357) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 21 10:49:59.380484 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-755d0549-3887-4620-a0c1-bf30cd8ad933 tempest-ListServersNegativeTestJSON-1963586981 tempest-ListServersNegativeTestJSON-1963586981-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:49:59.381627 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-755d0549-3887-4620-a0c1-bf30cd8ad933 tempest-ListServersNegativeTestJSON-1963586981 tempest-ListServersNegativeTestJSON-1963586981-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:49:59.440051 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-755d0549-3887-4620-a0c1-bf30cd8ad933 tempest-ListServersNegativeTestJSON-1963586981 tempest-ListServersNegativeTestJSON-1963586981-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:49:59.440559 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-755d0549-3887-4620-a0c1-bf30cd8ad933 tempest-ListServersNegativeTestJSON-1963586981 tempest-ListServersNegativeTestJSON-1963586981-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:49:59.466496 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-755d0549-3887-4620-a0c1-bf30cd8ad933 tempest-ListServersNegativeTestJSON-1963586981 tempest-ListServersNegativeTestJSON-1963586981-project] [instance: 364ddf7b-6b81-49a3-a2cb-21487632b7ad] Selected host: n-h2-811414-3; Selected node: n-h2-811414-3; Alternates: [('n-h1-811414-3', 'n-h1-811414-3')] {{(pid=94357) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 21 10:49:59.467350 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-755d0549-3887-4620-a0c1-bf30cd8ad933 tempest-ListServersNegativeTestJSON-1963586981 tempest-ListServersNegativeTestJSON-1963586981-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:49:59.467757 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-755d0549-3887-4620-a0c1-bf30cd8ad933 tempest-ListServersNegativeTestJSON-1963586981 tempest-ListServersNegativeTestJSON-1963586981-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:49:59.487313 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-755d0549-3887-4620-a0c1-bf30cd8ad933 tempest-ListServersNegativeTestJSON-1963586981 tempest-ListServersNegativeTestJSON-1963586981-project] [instance: 364ddf7b-6b81-49a3-a2cb-21487632b7ad] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f5cdc3d5-9524-4220-a7fc-ab5606975fdb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94357) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 21 10:49:59.489350 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-755d0549-3887-4620-a0c1-bf30cd8ad933 tempest-ListServersNegativeTestJSON-1963586981 tempest-ListServersNegativeTestJSON-1963586981-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:49:59.489772 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-755d0549-3887-4620-a0c1-bf30cd8ad933 tempest-ListServersNegativeTestJSON-1963586981 tempest-ListServersNegativeTestJSON-1963586981-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:49:59.545195 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-755d0549-3887-4620-a0c1-bf30cd8ad933 tempest-ListServersNegativeTestJSON-1963586981 tempest-ListServersNegativeTestJSON-1963586981-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:49:59.546082 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-755d0549-3887-4620-a0c1-bf30cd8ad933 tempest-ListServersNegativeTestJSON-1963586981 tempest-ListServersNegativeTestJSON-1963586981-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:50:02.820102 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-ab9235d7-5538-4f2a-960f-7c0b7a043d5a tempest-InstanceActionsNegativeTestJSON-2052349716 tempest-InstanceActionsNegativeTestJSON-2052349716-project] Took 0.42 seconds to select destinations for 1 instance(s). {{(pid=94358) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 21 10:50:02.865540 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-ab9235d7-5538-4f2a-960f-7c0b7a043d5a tempest-InstanceActionsNegativeTestJSON-2052349716 tempest-InstanceActionsNegativeTestJSON-2052349716-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:50:02.865948 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-ab9235d7-5538-4f2a-960f-7c0b7a043d5a tempest-InstanceActionsNegativeTestJSON-2052349716 tempest-InstanceActionsNegativeTestJSON-2052349716-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:50:02.941880 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-ab9235d7-5538-4f2a-960f-7c0b7a043d5a tempest-InstanceActionsNegativeTestJSON-2052349716 tempest-InstanceActionsNegativeTestJSON-2052349716-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:50:02.942286 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-ab9235d7-5538-4f2a-960f-7c0b7a043d5a tempest-InstanceActionsNegativeTestJSON-2052349716 tempest-InstanceActionsNegativeTestJSON-2052349716-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:50:02.943016 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-ab9235d7-5538-4f2a-960f-7c0b7a043d5a tempest-InstanceActionsNegativeTestJSON-2052349716 tempest-InstanceActionsNegativeTestJSON-2052349716-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:50:02.943406 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-ab9235d7-5538-4f2a-960f-7c0b7a043d5a tempest-InstanceActionsNegativeTestJSON-2052349716 tempest-InstanceActionsNegativeTestJSON-2052349716-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:50:03.015261 n-d-811414-3 nova-conductor[94358]: DEBUG nova.quota [None req-ab9235d7-5538-4f2a-960f-7c0b7a043d5a tempest-InstanceActionsNegativeTestJSON-2052349716 tempest-InstanceActionsNegativeTestJSON-2052349716-project] Getting quotas for project 9df96b6a7f11485abe58bab4dd43a518. Resources: {'instances', 'cores', 'ram'} {{(pid=94358) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 21 10:50:03.023739 n-d-811414-3 nova-conductor[94358]: DEBUG nova.quota [None req-ab9235d7-5538-4f2a-960f-7c0b7a043d5a tempest-InstanceActionsNegativeTestJSON-2052349716 tempest-InstanceActionsNegativeTestJSON-2052349716-project] Getting quotas for user b064b2429aa3408985cd44d4dc1b4cbc and project 9df96b6a7f11485abe58bab4dd43a518. Resources: {'instances', 'cores', 'ram'} {{(pid=94358) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 21 10:50:03.045183 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-ab9235d7-5538-4f2a-960f-7c0b7a043d5a tempest-InstanceActionsNegativeTestJSON-2052349716 tempest-InstanceActionsNegativeTestJSON-2052349716-project] [instance: 970063c6-127c-40c4-a12a-7383947ef98d] Selected host: n-h2-811414-3; Selected node: n-h2-811414-3; Alternates: [('n-h1-811414-3', 'n-h1-811414-3')] {{(pid=94358) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 21 10:50:03.046321 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-ab9235d7-5538-4f2a-960f-7c0b7a043d5a tempest-InstanceActionsNegativeTestJSON-2052349716 tempest-InstanceActionsNegativeTestJSON-2052349716-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:50:03.046814 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-ab9235d7-5538-4f2a-960f-7c0b7a043d5a tempest-InstanceActionsNegativeTestJSON-2052349716 tempest-InstanceActionsNegativeTestJSON-2052349716-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:50:03.060362 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-ab9235d7-5538-4f2a-960f-7c0b7a043d5a tempest-InstanceActionsNegativeTestJSON-2052349716 tempest-InstanceActionsNegativeTestJSON-2052349716-project] [instance: 970063c6-127c-40c4-a12a-7383947ef98d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f5cdc3d5-9524-4220-a7fc-ab5606975fdb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94358) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 21 10:50:03.062257 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-ab9235d7-5538-4f2a-960f-7c0b7a043d5a tempest-InstanceActionsNegativeTestJSON-2052349716 tempest-InstanceActionsNegativeTestJSON-2052349716-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:50:03.064013 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-ab9235d7-5538-4f2a-960f-7c0b7a043d5a tempest-InstanceActionsNegativeTestJSON-2052349716 tempest-InstanceActionsNegativeTestJSON-2052349716-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:50:03.111368 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-ab9235d7-5538-4f2a-960f-7c0b7a043d5a tempest-InstanceActionsNegativeTestJSON-2052349716 tempest-InstanceActionsNegativeTestJSON-2052349716-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:50:03.111899 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-ab9235d7-5538-4f2a-960f-7c0b7a043d5a tempest-InstanceActionsNegativeTestJSON-2052349716 tempest-InstanceActionsNegativeTestJSON-2052349716-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:50:17.022628 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-b81a00c4-140b-4d8c-a1e7-0e164dbe597c tempest-ServerDiskConfigTestJSON-900499457 tempest-ServerDiskConfigTestJSON-900499457-project] Took 0.35 seconds to select destinations for 1 instance(s). {{(pid=94357) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 21 10:50:17.047937 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-b81a00c4-140b-4d8c-a1e7-0e164dbe597c tempest-ServerDiskConfigTestJSON-900499457 tempest-ServerDiskConfigTestJSON-900499457-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:50:17.048721 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-b81a00c4-140b-4d8c-a1e7-0e164dbe597c tempest-ServerDiskConfigTestJSON-900499457 tempest-ServerDiskConfigTestJSON-900499457-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:50:17.097353 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-b81a00c4-140b-4d8c-a1e7-0e164dbe597c tempest-ServerDiskConfigTestJSON-900499457 tempest-ServerDiskConfigTestJSON-900499457-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:50:17.098247 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-b81a00c4-140b-4d8c-a1e7-0e164dbe597c tempest-ServerDiskConfigTestJSON-900499457 tempest-ServerDiskConfigTestJSON-900499457-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:50:17.099236 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-b81a00c4-140b-4d8c-a1e7-0e164dbe597c tempest-ServerDiskConfigTestJSON-900499457 tempest-ServerDiskConfigTestJSON-900499457-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:50:17.099835 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-b81a00c4-140b-4d8c-a1e7-0e164dbe597c tempest-ServerDiskConfigTestJSON-900499457 tempest-ServerDiskConfigTestJSON-900499457-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:50:17.118648 n-d-811414-3 nova-conductor[94357]: DEBUG nova.quota [None req-b81a00c4-140b-4d8c-a1e7-0e164dbe597c tempest-ServerDiskConfigTestJSON-900499457 tempest-ServerDiskConfigTestJSON-900499457-project] Getting quotas for project 78a902223fa5427fa8674f3c72f167d5. Resources: {'instances', 'cores', 'ram'} {{(pid=94357) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 21 10:50:17.123809 n-d-811414-3 nova-conductor[94357]: DEBUG nova.quota [None req-b81a00c4-140b-4d8c-a1e7-0e164dbe597c tempest-ServerDiskConfigTestJSON-900499457 tempest-ServerDiskConfigTestJSON-900499457-project] Getting quotas for user 7e648cbf76134a7cb08ed2747dfcf7c3 and project 78a902223fa5427fa8674f3c72f167d5. Resources: {'instances', 'cores', 'ram'} {{(pid=94357) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 21 10:50:17.136469 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-b81a00c4-140b-4d8c-a1e7-0e164dbe597c tempest-ServerDiskConfigTestJSON-900499457 tempest-ServerDiskConfigTestJSON-900499457-project] [instance: 876d6cbf-9ba0-413e-a8ee-3f6c61004aaa] Selected host: n-h2-811414-3; Selected node: n-h2-811414-3; Alternates: [('n-h1-811414-3', 'n-h1-811414-3')] {{(pid=94357) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 21 10:50:17.137797 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-b81a00c4-140b-4d8c-a1e7-0e164dbe597c tempest-ServerDiskConfigTestJSON-900499457 tempest-ServerDiskConfigTestJSON-900499457-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:50:17.138412 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-b81a00c4-140b-4d8c-a1e7-0e164dbe597c tempest-ServerDiskConfigTestJSON-900499457 tempest-ServerDiskConfigTestJSON-900499457-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:50:17.146503 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-b81a00c4-140b-4d8c-a1e7-0e164dbe597c tempest-ServerDiskConfigTestJSON-900499457 tempest-ServerDiskConfigTestJSON-900499457-project] [instance: 876d6cbf-9ba0-413e-a8ee-3f6c61004aaa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f5cdc3d5-9524-4220-a7fc-ab5606975fdb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94357) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 21 10:50:17.148298 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-b81a00c4-140b-4d8c-a1e7-0e164dbe597c tempest-ServerDiskConfigTestJSON-900499457 tempest-ServerDiskConfigTestJSON-900499457-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:50:17.149325 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-b81a00c4-140b-4d8c-a1e7-0e164dbe597c tempest-ServerDiskConfigTestJSON-900499457 tempest-ServerDiskConfigTestJSON-900499457-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:50:17.193370 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-b81a00c4-140b-4d8c-a1e7-0e164dbe597c tempest-ServerDiskConfigTestJSON-900499457 tempest-ServerDiskConfigTestJSON-900499457-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:50:17.194112 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-b81a00c4-140b-4d8c-a1e7-0e164dbe597c tempest-ServerDiskConfigTestJSON-900499457 tempest-ServerDiskConfigTestJSON-900499457-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:50:17.862931 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-61aaba05-1d9a-4d96-b581-17f2c2879a05 tempest-ServersOnMultiNodesTest-174179125 tempest-ServersOnMultiNodesTest-174179125-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:50:17.863403 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-61aaba05-1d9a-4d96-b581-17f2c2879a05 tempest-ServersOnMultiNodesTest-174179125 tempest-ServersOnMultiNodesTest-174179125-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:50:18.498523 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-61aaba05-1d9a-4d96-b581-17f2c2879a05 tempest-ServersOnMultiNodesTest-174179125 tempest-ServersOnMultiNodesTest-174179125-project] Took 0.59 seconds to select destinations for 2 instance(s). {{(pid=94358) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 21 10:50:18.540588 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-61aaba05-1d9a-4d96-b581-17f2c2879a05 tempest-ServersOnMultiNodesTest-174179125 tempest-ServersOnMultiNodesTest-174179125-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:50:18.541001 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-61aaba05-1d9a-4d96-b581-17f2c2879a05 tempest-ServersOnMultiNodesTest-174179125 tempest-ServersOnMultiNodesTest-174179125-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:50:18.669851 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-61aaba05-1d9a-4d96-b581-17f2c2879a05 tempest-ServersOnMultiNodesTest-174179125 tempest-ServersOnMultiNodesTest-174179125-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:50:18.670563 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-61aaba05-1d9a-4d96-b581-17f2c2879a05 tempest-ServersOnMultiNodesTest-174179125 tempest-ServersOnMultiNodesTest-174179125-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:50:18.752432 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-61aaba05-1d9a-4d96-b581-17f2c2879a05 tempest-ServersOnMultiNodesTest-174179125 tempest-ServersOnMultiNodesTest-174179125-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:50:18.756225 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-61aaba05-1d9a-4d96-b581-17f2c2879a05 tempest-ServersOnMultiNodesTest-174179125 tempest-ServersOnMultiNodesTest-174179125-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:50:18.757339 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-61aaba05-1d9a-4d96-b581-17f2c2879a05 tempest-ServersOnMultiNodesTest-174179125 tempest-ServersOnMultiNodesTest-174179125-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:50:18.758026 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-61aaba05-1d9a-4d96-b581-17f2c2879a05 tempest-ServersOnMultiNodesTest-174179125 tempest-ServersOnMultiNodesTest-174179125-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:50:18.802623 n-d-811414-3 nova-conductor[94358]: DEBUG nova.quota [None req-61aaba05-1d9a-4d96-b581-17f2c2879a05 tempest-ServersOnMultiNodesTest-174179125 tempest-ServersOnMultiNodesTest-174179125-project] Getting quotas for project 2430b168754442d1b4fdbcfa80bfaccd. Resources: {'instances', 'cores', 'ram'} {{(pid=94358) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 21 10:50:18.813911 n-d-811414-3 nova-conductor[94358]: DEBUG nova.quota [None req-61aaba05-1d9a-4d96-b581-17f2c2879a05 tempest-ServersOnMultiNodesTest-174179125 tempest-ServersOnMultiNodesTest-174179125-project] Getting quotas for user 831e8270c33b4193b8d2d4ae2098f5da and project 2430b168754442d1b4fdbcfa80bfaccd. Resources: {'instances', 'cores', 'ram'} {{(pid=94358) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 21 10:50:18.830154 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-61aaba05-1d9a-4d96-b581-17f2c2879a05 tempest-ServersOnMultiNodesTest-174179125 tempest-ServersOnMultiNodesTest-174179125-project] [instance: 31a5564c-656c-414e-a608-6b1956b9ec8a] Selected host: n-h2-811414-3; Selected node: n-h2-811414-3; Alternates: [] {{(pid=94358) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 21 10:50:18.831354 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-61aaba05-1d9a-4d96-b581-17f2c2879a05 tempest-ServersOnMultiNodesTest-174179125 tempest-ServersOnMultiNodesTest-174179125-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:50:18.831866 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-61aaba05-1d9a-4d96-b581-17f2c2879a05 tempest-ServersOnMultiNodesTest-174179125 tempest-ServersOnMultiNodesTest-174179125-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:50:18.841130 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-61aaba05-1d9a-4d96-b581-17f2c2879a05 tempest-ServersOnMultiNodesTest-174179125 tempest-ServersOnMultiNodesTest-174179125-project] [instance: 31a5564c-656c-414e-a608-6b1956b9ec8a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f5cdc3d5-9524-4220-a7fc-ab5606975fdb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94358) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 21 10:50:18.842551 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-61aaba05-1d9a-4d96-b581-17f2c2879a05 tempest-ServersOnMultiNodesTest-174179125 tempest-ServersOnMultiNodesTest-174179125-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:50:18.843484 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-61aaba05-1d9a-4d96-b581-17f2c2879a05 tempest-ServersOnMultiNodesTest-174179125 tempest-ServersOnMultiNodesTest-174179125-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:50:18.902137 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-61aaba05-1d9a-4d96-b581-17f2c2879a05 tempest-ServersOnMultiNodesTest-174179125 tempest-ServersOnMultiNodesTest-174179125-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:50:18.903319 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-61aaba05-1d9a-4d96-b581-17f2c2879a05 tempest-ServersOnMultiNodesTest-174179125 tempest-ServersOnMultiNodesTest-174179125-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:50:18.925900 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-61aaba05-1d9a-4d96-b581-17f2c2879a05 tempest-ServersOnMultiNodesTest-174179125 tempest-ServersOnMultiNodesTest-174179125-project] [instance: a0cf0d19-77bf-4e02-9de5-b4201b8cd3fd] Selected host: n-h1-811414-3; Selected node: n-h1-811414-3; Alternates: [] {{(pid=94358) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 21 10:50:18.926651 n-d-811414-3 nova-conductor[94358]: DEBUG nova.objects.instance_group [None req-61aaba05-1d9a-4d96-b581-17f2c2879a05 tempest-ServersOnMultiNodesTest-174179125 tempest-ServersOnMultiNodesTest-174179125-project] Lazy-loading 'hosts' on InstanceGroup uuid d1d171f9-6ea7-48fb-a579-6d3332879dd9 {{(pid=94358) obj_load_attr /opt/stack/nova/nova/objects/instance_group.py:357}} Apr 21 10:50:18.955324 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-61aaba05-1d9a-4d96-b581-17f2c2879a05 tempest-ServersOnMultiNodesTest-174179125 tempest-ServersOnMultiNodesTest-174179125-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:50:18.955986 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-61aaba05-1d9a-4d96-b581-17f2c2879a05 tempest-ServersOnMultiNodesTest-174179125 tempest-ServersOnMultiNodesTest-174179125-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:50:18.965198 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-61aaba05-1d9a-4d96-b581-17f2c2879a05 tempest-ServersOnMultiNodesTest-174179125 tempest-ServersOnMultiNodesTest-174179125-project] [instance: a0cf0d19-77bf-4e02-9de5-b4201b8cd3fd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f5cdc3d5-9524-4220-a7fc-ab5606975fdb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94358) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 21 10:50:18.967103 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-61aaba05-1d9a-4d96-b581-17f2c2879a05 tempest-ServersOnMultiNodesTest-174179125 tempest-ServersOnMultiNodesTest-174179125-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:50:18.967738 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-61aaba05-1d9a-4d96-b581-17f2c2879a05 tempest-ServersOnMultiNodesTest-174179125 tempest-ServersOnMultiNodesTest-174179125-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:50:19.047938 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-61aaba05-1d9a-4d96-b581-17f2c2879a05 tempest-ServersOnMultiNodesTest-174179125 tempest-ServersOnMultiNodesTest-174179125-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:50:19.048896 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-61aaba05-1d9a-4d96-b581-17f2c2879a05 tempest-ServersOnMultiNodesTest-174179125 tempest-ServersOnMultiNodesTest-174179125-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:50:32.952646 n-d-811414-3 nova-conductor[94358]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f60095b5-b68f-459e-af9a-3776dcd48c13] AMQP server on 10.222.0.13:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 21 10:50:33.966546 n-d-811414-3 nova-conductor[94358]: INFO oslo.messaging._drivers.impl_rabbit [-] [f60095b5-b68f-459e-af9a-3776dcd48c13] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 50656. Apr 21 10:50:45.920981 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-316cb4a3-1d8f-4e5a-b876-01c2b4f9ec55 tempest-ServersAaction247Test-1256806990 tempest-ServersAaction247Test-1256806990-project] Took 0.38 seconds to select destinations for 1 instance(s). {{(pid=94357) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 21 10:50:45.953521 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-316cb4a3-1d8f-4e5a-b876-01c2b4f9ec55 tempest-ServersAaction247Test-1256806990 tempest-ServersAaction247Test-1256806990-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:50:45.954603 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-316cb4a3-1d8f-4e5a-b876-01c2b4f9ec55 tempest-ServersAaction247Test-1256806990 tempest-ServersAaction247Test-1256806990-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:50:46.016724 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-316cb4a3-1d8f-4e5a-b876-01c2b4f9ec55 tempest-ServersAaction247Test-1256806990 tempest-ServersAaction247Test-1256806990-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:50:46.017360 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-316cb4a3-1d8f-4e5a-b876-01c2b4f9ec55 tempest-ServersAaction247Test-1256806990 tempest-ServersAaction247Test-1256806990-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:50:46.018260 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-316cb4a3-1d8f-4e5a-b876-01c2b4f9ec55 tempest-ServersAaction247Test-1256806990 tempest-ServersAaction247Test-1256806990-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:50:46.018842 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-316cb4a3-1d8f-4e5a-b876-01c2b4f9ec55 tempest-ServersAaction247Test-1256806990 tempest-ServersAaction247Test-1256806990-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:50:46.039704 n-d-811414-3 nova-conductor[94357]: DEBUG nova.quota [None req-316cb4a3-1d8f-4e5a-b876-01c2b4f9ec55 tempest-ServersAaction247Test-1256806990 tempest-ServersAaction247Test-1256806990-project] Getting quotas for project 5273478ffab9474ca307d089e871ff7e. Resources: {'instances', 'cores', 'ram'} {{(pid=94357) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 21 10:50:46.047200 n-d-811414-3 nova-conductor[94357]: DEBUG nova.quota [None req-316cb4a3-1d8f-4e5a-b876-01c2b4f9ec55 tempest-ServersAaction247Test-1256806990 tempest-ServersAaction247Test-1256806990-project] Getting quotas for user 94e6b1e885b0435e8ea5af26df86d1d5 and project 5273478ffab9474ca307d089e871ff7e. Resources: {'instances', 'cores', 'ram'} {{(pid=94357) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 21 10:50:46.060410 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-316cb4a3-1d8f-4e5a-b876-01c2b4f9ec55 tempest-ServersAaction247Test-1256806990 tempest-ServersAaction247Test-1256806990-project] [instance: 980f6001-76ab-4cde-9d02-dee330267cc5] Selected host: n-h2-811414-3; Selected node: n-h2-811414-3; Alternates: [('n-h1-811414-3', 'n-h1-811414-3')] {{(pid=94357) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 21 10:50:46.062190 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-316cb4a3-1d8f-4e5a-b876-01c2b4f9ec55 tempest-ServersAaction247Test-1256806990 tempest-ServersAaction247Test-1256806990-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:50:46.062836 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-316cb4a3-1d8f-4e5a-b876-01c2b4f9ec55 tempest-ServersAaction247Test-1256806990 tempest-ServersAaction247Test-1256806990-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:50:46.071072 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-316cb4a3-1d8f-4e5a-b876-01c2b4f9ec55 tempest-ServersAaction247Test-1256806990 tempest-ServersAaction247Test-1256806990-project] [instance: 980f6001-76ab-4cde-9d02-dee330267cc5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f5cdc3d5-9524-4220-a7fc-ab5606975fdb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94357) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 21 10:50:46.073600 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-316cb4a3-1d8f-4e5a-b876-01c2b4f9ec55 tempest-ServersAaction247Test-1256806990 tempest-ServersAaction247Test-1256806990-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:50:46.074371 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-316cb4a3-1d8f-4e5a-b876-01c2b4f9ec55 tempest-ServersAaction247Test-1256806990 tempest-ServersAaction247Test-1256806990-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:50:46.112050 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-316cb4a3-1d8f-4e5a-b876-01c2b4f9ec55 tempest-ServersAaction247Test-1256806990 tempest-ServersAaction247Test-1256806990-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:50:46.113392 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-316cb4a3-1d8f-4e5a-b876-01c2b4f9ec55 tempest-ServersAaction247Test-1256806990 tempest-ServersAaction247Test-1256806990-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:50:55.466451 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-9f480da9-fb7d-4dcc-b43b-af80d4abea99 tempest-ServerDiskConfigTestJSON-900499457 tempest-ServerDiskConfigTestJSON-900499457-project] Targeting cell 6c99d8ec-fb48-48af-b02b-a629a7c2cb6b(cell1) for conductor method rebuild_instance {{(pid=94358) wrapper /opt/stack/nova/nova/conductor/manager.py:91}} Apr 21 10:50:55.468662 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-9f480da9-fb7d-4dcc-b43b-af80d4abea99 tempest-ServerDiskConfigTestJSON-900499457 tempest-ServerDiskConfigTestJSON-900499457-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:50:55.469556 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-9f480da9-fb7d-4dcc-b43b-af80d4abea99 tempest-ServerDiskConfigTestJSON-900499457 tempest-ServerDiskConfigTestJSON-900499457-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:50:55.490292 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-9f480da9-fb7d-4dcc-b43b-af80d4abea99 tempest-ServerDiskConfigTestJSON-900499457 tempest-ServerDiskConfigTestJSON-900499457-project] [instance: 876d6cbf-9ba0-413e-a8ee-3f6c61004aaa] No migration record for the rebuild/evacuate request. {{(pid=94358) rebuild_instance /opt/stack/nova/nova/conductor/manager.py:1101}} Apr 21 10:50:57.655941 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-a1257049-3f93-4e07-9399-4c8a7c6684e8 tempest-ServersOnMultiNodesTest-174179125 tempest-ServersOnMultiNodesTest-174179125-project] Took 0.36 seconds to select destinations for 1 instance(s). {{(pid=94357) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 21 10:50:57.703535 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-a1257049-3f93-4e07-9399-4c8a7c6684e8 tempest-ServersOnMultiNodesTest-174179125 tempest-ServersOnMultiNodesTest-174179125-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:50:57.703943 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-a1257049-3f93-4e07-9399-4c8a7c6684e8 tempest-ServersOnMultiNodesTest-174179125 tempest-ServersOnMultiNodesTest-174179125-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:50:57.762129 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-a1257049-3f93-4e07-9399-4c8a7c6684e8 tempest-ServersOnMultiNodesTest-174179125 tempest-ServersOnMultiNodesTest-174179125-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:50:57.762576 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-a1257049-3f93-4e07-9399-4c8a7c6684e8 tempest-ServersOnMultiNodesTest-174179125 tempest-ServersOnMultiNodesTest-174179125-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:50:57.763295 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-a1257049-3f93-4e07-9399-4c8a7c6684e8 tempest-ServersOnMultiNodesTest-174179125 tempest-ServersOnMultiNodesTest-174179125-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:50:57.763719 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-a1257049-3f93-4e07-9399-4c8a7c6684e8 tempest-ServersOnMultiNodesTest-174179125 tempest-ServersOnMultiNodesTest-174179125-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:50:57.783024 n-d-811414-3 nova-conductor[94357]: DEBUG nova.quota [None req-a1257049-3f93-4e07-9399-4c8a7c6684e8 tempest-ServersOnMultiNodesTest-174179125 tempest-ServersOnMultiNodesTest-174179125-project] Getting quotas for project 2430b168754442d1b4fdbcfa80bfaccd. Resources: {'instances', 'cores', 'ram'} {{(pid=94357) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 21 10:50:57.787976 n-d-811414-3 nova-conductor[94357]: DEBUG nova.quota [None req-a1257049-3f93-4e07-9399-4c8a7c6684e8 tempest-ServersOnMultiNodesTest-174179125 tempest-ServersOnMultiNodesTest-174179125-project] Getting quotas for user 831e8270c33b4193b8d2d4ae2098f5da and project 2430b168754442d1b4fdbcfa80bfaccd. Resources: {'instances', 'cores', 'ram'} {{(pid=94357) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 21 10:50:57.801620 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-a1257049-3f93-4e07-9399-4c8a7c6684e8 tempest-ServersOnMultiNodesTest-174179125 tempest-ServersOnMultiNodesTest-174179125-project] [instance: c2a4b3fd-88dd-4dfa-84e0-83deb6d323df] Selected host: n-h1-811414-3; Selected node: n-h1-811414-3; Alternates: [] {{(pid=94357) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 21 10:50:57.802883 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-a1257049-3f93-4e07-9399-4c8a7c6684e8 tempest-ServersOnMultiNodesTest-174179125 tempest-ServersOnMultiNodesTest-174179125-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:50:57.803430 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-a1257049-3f93-4e07-9399-4c8a7c6684e8 tempest-ServersOnMultiNodesTest-174179125 tempest-ServersOnMultiNodesTest-174179125-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:50:57.821027 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-a1257049-3f93-4e07-9399-4c8a7c6684e8 tempest-ServersOnMultiNodesTest-174179125 tempest-ServersOnMultiNodesTest-174179125-project] [instance: c2a4b3fd-88dd-4dfa-84e0-83deb6d323df] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f5cdc3d5-9524-4220-a7fc-ab5606975fdb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94357) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 21 10:50:57.825175 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-a1257049-3f93-4e07-9399-4c8a7c6684e8 tempest-ServersOnMultiNodesTest-174179125 tempest-ServersOnMultiNodesTest-174179125-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:50:57.828207 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-a1257049-3f93-4e07-9399-4c8a7c6684e8 tempest-ServersOnMultiNodesTest-174179125 tempest-ServersOnMultiNodesTest-174179125-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:50:57.887792 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-a1257049-3f93-4e07-9399-4c8a7c6684e8 tempest-ServersOnMultiNodesTest-174179125 tempest-ServersOnMultiNodesTest-174179125-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:50:57.888474 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-a1257049-3f93-4e07-9399-4c8a7c6684e8 tempest-ServersOnMultiNodesTest-174179125 tempest-ServersOnMultiNodesTest-174179125-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:51:08.433548 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-1864ac03-7062-49b1-8284-162259dd67aa tempest-ServerMetadataNegativeTestJSON-139899980 tempest-ServerMetadataNegativeTestJSON-139899980-project] Took 0.22 seconds to select destinations for 1 instance(s). {{(pid=94358) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 21 10:51:08.455412 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-1864ac03-7062-49b1-8284-162259dd67aa tempest-ServerMetadataNegativeTestJSON-139899980 tempest-ServerMetadataNegativeTestJSON-139899980-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:51:08.455895 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-1864ac03-7062-49b1-8284-162259dd67aa tempest-ServerMetadataNegativeTestJSON-139899980 tempest-ServerMetadataNegativeTestJSON-139899980-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:51:08.514066 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-1864ac03-7062-49b1-8284-162259dd67aa tempest-ServerMetadataNegativeTestJSON-139899980 tempest-ServerMetadataNegativeTestJSON-139899980-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:51:08.515411 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-1864ac03-7062-49b1-8284-162259dd67aa tempest-ServerMetadataNegativeTestJSON-139899980 tempest-ServerMetadataNegativeTestJSON-139899980-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:51:08.516149 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-1864ac03-7062-49b1-8284-162259dd67aa tempest-ServerMetadataNegativeTestJSON-139899980 tempest-ServerMetadataNegativeTestJSON-139899980-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:51:08.516574 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-1864ac03-7062-49b1-8284-162259dd67aa tempest-ServerMetadataNegativeTestJSON-139899980 tempest-ServerMetadataNegativeTestJSON-139899980-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:51:08.532194 n-d-811414-3 nova-conductor[94358]: DEBUG nova.quota [None req-1864ac03-7062-49b1-8284-162259dd67aa tempest-ServerMetadataNegativeTestJSON-139899980 tempest-ServerMetadataNegativeTestJSON-139899980-project] Getting quotas for project 99c487b5e665450080f47f1622257640. Resources: {'instances', 'cores', 'ram'} {{(pid=94358) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 21 10:51:08.536786 n-d-811414-3 nova-conductor[94358]: DEBUG nova.quota [None req-1864ac03-7062-49b1-8284-162259dd67aa tempest-ServerMetadataNegativeTestJSON-139899980 tempest-ServerMetadataNegativeTestJSON-139899980-project] Getting quotas for user e3c610607ae443ccb280410b8ad4df74 and project 99c487b5e665450080f47f1622257640. Resources: {'instances', 'cores', 'ram'} {{(pid=94358) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 21 10:51:08.547808 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-1864ac03-7062-49b1-8284-162259dd67aa tempest-ServerMetadataNegativeTestJSON-139899980 tempest-ServerMetadataNegativeTestJSON-139899980-project] [instance: 6c7b84e3-5286-465e-bdc4-dc117705e32e] Selected host: n-h2-811414-3; Selected node: n-h2-811414-3; Alternates: [('n-h1-811414-3', 'n-h1-811414-3')] {{(pid=94358) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 21 10:51:08.548759 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-1864ac03-7062-49b1-8284-162259dd67aa tempest-ServerMetadataNegativeTestJSON-139899980 tempest-ServerMetadataNegativeTestJSON-139899980-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:51:08.549159 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-1864ac03-7062-49b1-8284-162259dd67aa tempest-ServerMetadataNegativeTestJSON-139899980 tempest-ServerMetadataNegativeTestJSON-139899980-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:51:08.555949 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-1864ac03-7062-49b1-8284-162259dd67aa tempest-ServerMetadataNegativeTestJSON-139899980 tempest-ServerMetadataNegativeTestJSON-139899980-project] [instance: 6c7b84e3-5286-465e-bdc4-dc117705e32e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f5cdc3d5-9524-4220-a7fc-ab5606975fdb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94358) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 21 10:51:08.557410 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-1864ac03-7062-49b1-8284-162259dd67aa tempest-ServerMetadataNegativeTestJSON-139899980 tempest-ServerMetadataNegativeTestJSON-139899980-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:51:08.557807 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-1864ac03-7062-49b1-8284-162259dd67aa tempest-ServerMetadataNegativeTestJSON-139899980 tempest-ServerMetadataNegativeTestJSON-139899980-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:51:08.586634 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-1864ac03-7062-49b1-8284-162259dd67aa tempest-ServerMetadataNegativeTestJSON-139899980 tempest-ServerMetadataNegativeTestJSON-139899980-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:51:08.587077 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-1864ac03-7062-49b1-8284-162259dd67aa tempest-ServerMetadataNegativeTestJSON-139899980 tempest-ServerMetadataNegativeTestJSON-139899980-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:51:19.476699 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-6d3b6d64-323e-4aa3-83b1-e19cea17f437 tempest-TaggedBootDevicesTest_v242-1423130446 tempest-TaggedBootDevicesTest_v242-1423130446-project] Took 0.37 seconds to select destinations for 1 instance(s). {{(pid=94357) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 21 10:51:19.510780 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-6d3b6d64-323e-4aa3-83b1-e19cea17f437 tempest-TaggedBootDevicesTest_v242-1423130446 tempest-TaggedBootDevicesTest_v242-1423130446-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:51:19.511452 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-6d3b6d64-323e-4aa3-83b1-e19cea17f437 tempest-TaggedBootDevicesTest_v242-1423130446 tempest-TaggedBootDevicesTest_v242-1423130446-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:51:19.614137 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-6d3b6d64-323e-4aa3-83b1-e19cea17f437 tempest-TaggedBootDevicesTest_v242-1423130446 tempest-TaggedBootDevicesTest_v242-1423130446-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:51:19.614542 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-6d3b6d64-323e-4aa3-83b1-e19cea17f437 tempest-TaggedBootDevicesTest_v242-1423130446 tempest-TaggedBootDevicesTest_v242-1423130446-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:51:19.616001 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-6d3b6d64-323e-4aa3-83b1-e19cea17f437 tempest-TaggedBootDevicesTest_v242-1423130446 tempest-TaggedBootDevicesTest_v242-1423130446-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:51:19.616643 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-6d3b6d64-323e-4aa3-83b1-e19cea17f437 tempest-TaggedBootDevicesTest_v242-1423130446 tempest-TaggedBootDevicesTest_v242-1423130446-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:51:19.641627 n-d-811414-3 nova-conductor[94357]: DEBUG nova.quota [None req-6d3b6d64-323e-4aa3-83b1-e19cea17f437 tempest-TaggedBootDevicesTest_v242-1423130446 tempest-TaggedBootDevicesTest_v242-1423130446-project] Getting quotas for project a8e190d927434b869d1ba09d06c92843. Resources: {'instances', 'cores', 'ram'} {{(pid=94357) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 21 10:51:19.650126 n-d-811414-3 nova-conductor[94357]: DEBUG nova.quota [None req-6d3b6d64-323e-4aa3-83b1-e19cea17f437 tempest-TaggedBootDevicesTest_v242-1423130446 tempest-TaggedBootDevicesTest_v242-1423130446-project] Getting quotas for user 951acbe388dc4a4abc9db44fd8f068bb and project a8e190d927434b869d1ba09d06c92843. Resources: {'instances', 'cores', 'ram'} {{(pid=94357) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 21 10:51:19.663292 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-6d3b6d64-323e-4aa3-83b1-e19cea17f437 tempest-TaggedBootDevicesTest_v242-1423130446 tempest-TaggedBootDevicesTest_v242-1423130446-project] [instance: deb0b5b9-6f65-4544-a612-3845110fd5fa] Selected host: n-h1-811414-3; Selected node: n-h1-811414-3; Alternates: [('n-h2-811414-3', 'n-h2-811414-3')] {{(pid=94357) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 21 10:51:19.664579 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-6d3b6d64-323e-4aa3-83b1-e19cea17f437 tempest-TaggedBootDevicesTest_v242-1423130446 tempest-TaggedBootDevicesTest_v242-1423130446-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:51:19.665569 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-6d3b6d64-323e-4aa3-83b1-e19cea17f437 tempest-TaggedBootDevicesTest_v242-1423130446 tempest-TaggedBootDevicesTest_v242-1423130446-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:51:19.673938 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-6d3b6d64-323e-4aa3-83b1-e19cea17f437 tempest-TaggedBootDevicesTest_v242-1423130446 tempest-TaggedBootDevicesTest_v242-1423130446-project] [instance: deb0b5b9-6f65-4544-a612-3845110fd5fa] block_device_mapping [BlockDeviceMapping(attachment_id=a67f8b64-9747-46fd-8134-ae86f64570c6,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='c874f774-0de0-4afe-a0ff-d8d9b1a68612',volume_size=1,volume_type=None), BlockDeviceMapping(attachment_id=19a5993b-1253-44c6-bb3f-c52624126d01,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='9502d353-37b1-482f-b7ba-3dfab1ad9d92',volume_size=1,volume_type=None), BlockDeviceMapping(attachment_id=a2bff407-2f1c-4177-94cd-47225a85b227,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='05dc7ae3-56f4-4692-ae04-62a88fb4c151',volume_size=1,volume_type=None)] {{(pid=94357) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 21 10:51:19.676589 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-6d3b6d64-323e-4aa3-83b1-e19cea17f437 tempest-TaggedBootDevicesTest_v242-1423130446 tempest-TaggedBootDevicesTest_v242-1423130446-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:51:19.677187 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-6d3b6d64-323e-4aa3-83b1-e19cea17f437 tempest-TaggedBootDevicesTest_v242-1423130446 tempest-TaggedBootDevicesTest_v242-1423130446-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:51:19.689254 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-6d3b6d64-323e-4aa3-83b1-e19cea17f437 tempest-TaggedBootDevicesTest_v242-1423130446 tempest-TaggedBootDevicesTest_v242-1423130446-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:51:19.691098 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-6d3b6d64-323e-4aa3-83b1-e19cea17f437 tempest-TaggedBootDevicesTest_v242-1423130446 tempest-TaggedBootDevicesTest_v242-1423130446-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:51:19.707581 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-6d3b6d64-323e-4aa3-83b1-e19cea17f437 tempest-TaggedBootDevicesTest_v242-1423130446 tempest-TaggedBootDevicesTest_v242-1423130446-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:51:19.708515 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-6d3b6d64-323e-4aa3-83b1-e19cea17f437 tempest-TaggedBootDevicesTest_v242-1423130446 tempest-TaggedBootDevicesTest_v242-1423130446-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:51:19.770084 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-6d3b6d64-323e-4aa3-83b1-e19cea17f437 tempest-TaggedBootDevicesTest_v242-1423130446 tempest-TaggedBootDevicesTest_v242-1423130446-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:51:19.771116 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-6d3b6d64-323e-4aa3-83b1-e19cea17f437 tempest-TaggedBootDevicesTest_v242-1423130446 tempest-TaggedBootDevicesTest_v242-1423130446-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:51:22.616364 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-59eff3be-7a52-4bd6-ae77-70247676dd2e tempest-ListServerFiltersTestJSON-810261055 tempest-ListServerFiltersTestJSON-810261055-project] Took 0.44 seconds to select destinations for 1 instance(s). {{(pid=94358) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 21 10:51:22.665763 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-59eff3be-7a52-4bd6-ae77-70247676dd2e tempest-ListServerFiltersTestJSON-810261055 tempest-ListServerFiltersTestJSON-810261055-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:51:22.667835 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-59eff3be-7a52-4bd6-ae77-70247676dd2e tempest-ListServerFiltersTestJSON-810261055 tempest-ListServerFiltersTestJSON-810261055-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:51:22.762176 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-59eff3be-7a52-4bd6-ae77-70247676dd2e tempest-ListServerFiltersTestJSON-810261055 tempest-ListServerFiltersTestJSON-810261055-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:51:22.763452 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-59eff3be-7a52-4bd6-ae77-70247676dd2e tempest-ListServerFiltersTestJSON-810261055 tempest-ListServerFiltersTestJSON-810261055-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:51:22.768558 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-59eff3be-7a52-4bd6-ae77-70247676dd2e tempest-ListServerFiltersTestJSON-810261055 tempest-ListServerFiltersTestJSON-810261055-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:51:22.769327 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-59eff3be-7a52-4bd6-ae77-70247676dd2e tempest-ListServerFiltersTestJSON-810261055 tempest-ListServerFiltersTestJSON-810261055-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:51:22.804241 n-d-811414-3 nova-conductor[94358]: DEBUG nova.quota [None req-59eff3be-7a52-4bd6-ae77-70247676dd2e tempest-ListServerFiltersTestJSON-810261055 tempest-ListServerFiltersTestJSON-810261055-project] Getting quotas for project 05dc1ec794254a05982d14bb108746a3. Resources: {'instances', 'cores', 'ram'} {{(pid=94358) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 21 10:51:22.811902 n-d-811414-3 nova-conductor[94358]: DEBUG nova.quota [None req-59eff3be-7a52-4bd6-ae77-70247676dd2e tempest-ListServerFiltersTestJSON-810261055 tempest-ListServerFiltersTestJSON-810261055-project] Getting quotas for user 5c164ebfb60e4c528c7d66b62173cf2b and project 05dc1ec794254a05982d14bb108746a3. Resources: {'instances', 'cores', 'ram'} {{(pid=94358) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 21 10:51:22.824596 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-59eff3be-7a52-4bd6-ae77-70247676dd2e tempest-ListServerFiltersTestJSON-810261055 tempest-ListServerFiltersTestJSON-810261055-project] [instance: 67f22d07-2cab-468b-b90d-62ab3d3e98a4] Selected host: n-h1-811414-3; Selected node: n-h1-811414-3; Alternates: [('n-h2-811414-3', 'n-h2-811414-3')] {{(pid=94358) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 21 10:51:22.825801 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-59eff3be-7a52-4bd6-ae77-70247676dd2e tempest-ListServerFiltersTestJSON-810261055 tempest-ListServerFiltersTestJSON-810261055-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:51:22.826960 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-59eff3be-7a52-4bd6-ae77-70247676dd2e tempest-ListServerFiltersTestJSON-810261055 tempest-ListServerFiltersTestJSON-810261055-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:51:22.837421 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-59eff3be-7a52-4bd6-ae77-70247676dd2e tempest-ListServerFiltersTestJSON-810261055 tempest-ListServerFiltersTestJSON-810261055-project] [instance: 67f22d07-2cab-468b-b90d-62ab3d3e98a4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f5cdc3d5-9524-4220-a7fc-ab5606975fdb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94358) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 21 10:51:22.839201 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-59eff3be-7a52-4bd6-ae77-70247676dd2e tempest-ListServerFiltersTestJSON-810261055 tempest-ListServerFiltersTestJSON-810261055-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:51:22.840068 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-59eff3be-7a52-4bd6-ae77-70247676dd2e tempest-ListServerFiltersTestJSON-810261055 tempest-ListServerFiltersTestJSON-810261055-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:51:22.898554 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-59eff3be-7a52-4bd6-ae77-70247676dd2e tempest-ListServerFiltersTestJSON-810261055 tempest-ListServerFiltersTestJSON-810261055-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:51:22.899117 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-59eff3be-7a52-4bd6-ae77-70247676dd2e tempest-ListServerFiltersTestJSON-810261055 tempest-ListServerFiltersTestJSON-810261055-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:51:27.148409 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-754e1e9d-0afa-48e6-8c13-f2375517b367 tempest-ListServerFiltersTestJSON-810261055 tempest-ListServerFiltersTestJSON-810261055-project] Took 0.43 seconds to select destinations for 1 instance(s). {{(pid=94357) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 21 10:51:27.189341 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-754e1e9d-0afa-48e6-8c13-f2375517b367 tempest-ListServerFiltersTestJSON-810261055 tempest-ListServerFiltersTestJSON-810261055-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:51:27.191101 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-754e1e9d-0afa-48e6-8c13-f2375517b367 tempest-ListServerFiltersTestJSON-810261055 tempest-ListServerFiltersTestJSON-810261055-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:51:27.284629 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-754e1e9d-0afa-48e6-8c13-f2375517b367 tempest-ListServerFiltersTestJSON-810261055 tempest-ListServerFiltersTestJSON-810261055-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:51:27.285285 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-754e1e9d-0afa-48e6-8c13-f2375517b367 tempest-ListServerFiltersTestJSON-810261055 tempest-ListServerFiltersTestJSON-810261055-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:51:27.287568 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-754e1e9d-0afa-48e6-8c13-f2375517b367 tempest-ListServerFiltersTestJSON-810261055 tempest-ListServerFiltersTestJSON-810261055-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:51:27.288079 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-754e1e9d-0afa-48e6-8c13-f2375517b367 tempest-ListServerFiltersTestJSON-810261055 tempest-ListServerFiltersTestJSON-810261055-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:51:27.330278 n-d-811414-3 nova-conductor[94357]: DEBUG nova.quota [None req-754e1e9d-0afa-48e6-8c13-f2375517b367 tempest-ListServerFiltersTestJSON-810261055 tempest-ListServerFiltersTestJSON-810261055-project] Getting quotas for project 05dc1ec794254a05982d14bb108746a3. Resources: {'instances', 'cores', 'ram'} {{(pid=94357) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 21 10:51:27.335690 n-d-811414-3 nova-conductor[94357]: DEBUG nova.quota [None req-754e1e9d-0afa-48e6-8c13-f2375517b367 tempest-ListServerFiltersTestJSON-810261055 tempest-ListServerFiltersTestJSON-810261055-project] Getting quotas for user 5c164ebfb60e4c528c7d66b62173cf2b and project 05dc1ec794254a05982d14bb108746a3. Resources: {'instances', 'cores', 'ram'} {{(pid=94357) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 21 10:51:27.369620 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-754e1e9d-0afa-48e6-8c13-f2375517b367 tempest-ListServerFiltersTestJSON-810261055 tempest-ListServerFiltersTestJSON-810261055-project] [instance: 25d8ba91-c0a3-4ba4-9586-0cdd1c2ad31a] Selected host: n-h2-811414-3; Selected node: n-h2-811414-3; Alternates: [('n-h1-811414-3', 'n-h1-811414-3')] {{(pid=94357) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 21 10:51:27.370938 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-754e1e9d-0afa-48e6-8c13-f2375517b367 tempest-ListServerFiltersTestJSON-810261055 tempest-ListServerFiltersTestJSON-810261055-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:51:27.371558 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-754e1e9d-0afa-48e6-8c13-f2375517b367 tempest-ListServerFiltersTestJSON-810261055 tempest-ListServerFiltersTestJSON-810261055-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:51:27.380898 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-754e1e9d-0afa-48e6-8c13-f2375517b367 tempest-ListServerFiltersTestJSON-810261055 tempest-ListServerFiltersTestJSON-810261055-project] [instance: 25d8ba91-c0a3-4ba4-9586-0cdd1c2ad31a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f5cdc3d5-9524-4220-a7fc-ab5606975fdb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94357) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 21 10:51:27.382563 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-754e1e9d-0afa-48e6-8c13-f2375517b367 tempest-ListServerFiltersTestJSON-810261055 tempest-ListServerFiltersTestJSON-810261055-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:51:27.383188 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-754e1e9d-0afa-48e6-8c13-f2375517b367 tempest-ListServerFiltersTestJSON-810261055 tempest-ListServerFiltersTestJSON-810261055-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:51:27.438041 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-754e1e9d-0afa-48e6-8c13-f2375517b367 tempest-ListServerFiltersTestJSON-810261055 tempest-ListServerFiltersTestJSON-810261055-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:51:27.438848 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-754e1e9d-0afa-48e6-8c13-f2375517b367 tempest-ListServerFiltersTestJSON-810261055 tempest-ListServerFiltersTestJSON-810261055-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:51:29.208112 n-d-811414-3 nova-conductor[94357]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6404cb3a-bdc9-481c-93a6-d63501b53d9b] AMQP server on 10.222.0.13:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 21 10:51:30.215646 n-d-811414-3 nova-conductor[94357]: INFO oslo.messaging._drivers.impl_rabbit [-] [6404cb3a-bdc9-481c-93a6-d63501b53d9b] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 51572. Apr 21 10:51:31.493929 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-b65aeae9-f9eb-4047-b371-4bc3e487b9bb tempest-ServerAddressesTestJSON-60624113 tempest-ServerAddressesTestJSON-60624113-project] Took 0.37 seconds to select destinations for 1 instance(s). {{(pid=94358) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 21 10:51:31.544518 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-b65aeae9-f9eb-4047-b371-4bc3e487b9bb tempest-ServerAddressesTestJSON-60624113 tempest-ServerAddressesTestJSON-60624113-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:51:31.544995 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-b65aeae9-f9eb-4047-b371-4bc3e487b9bb tempest-ServerAddressesTestJSON-60624113 tempest-ServerAddressesTestJSON-60624113-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:51:31.605262 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-b65aeae9-f9eb-4047-b371-4bc3e487b9bb tempest-ServerAddressesTestJSON-60624113 tempest-ServerAddressesTestJSON-60624113-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:51:31.605905 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-b65aeae9-f9eb-4047-b371-4bc3e487b9bb tempest-ServerAddressesTestJSON-60624113 tempest-ServerAddressesTestJSON-60624113-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:51:31.606780 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-b65aeae9-f9eb-4047-b371-4bc3e487b9bb tempest-ServerAddressesTestJSON-60624113 tempest-ServerAddressesTestJSON-60624113-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:51:31.607487 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-b65aeae9-f9eb-4047-b371-4bc3e487b9bb tempest-ServerAddressesTestJSON-60624113 tempest-ServerAddressesTestJSON-60624113-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:51:31.633018 n-d-811414-3 nova-conductor[94358]: DEBUG nova.quota [None req-b65aeae9-f9eb-4047-b371-4bc3e487b9bb tempest-ServerAddressesTestJSON-60624113 tempest-ServerAddressesTestJSON-60624113-project] Getting quotas for project f810607ec60b4c1dac9ff6f18b08b0a2. Resources: {'instances', 'cores', 'ram'} {{(pid=94358) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 21 10:51:31.636052 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-b3410948-6a31-4d5e-9259-2b1904564cb6 tempest-ListServerFiltersTestJSON-810261055 tempest-ListServerFiltersTestJSON-810261055-project] Took 0.32 seconds to select destinations for 1 instance(s). {{(pid=94357) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 21 10:51:31.639287 n-d-811414-3 nova-conductor[94358]: DEBUG nova.quota [None req-b65aeae9-f9eb-4047-b371-4bc3e487b9bb tempest-ServerAddressesTestJSON-60624113 tempest-ServerAddressesTestJSON-60624113-project] Getting quotas for user 6bf6c5f3086a463eaf9bfdac4ccb53cd and project f810607ec60b4c1dac9ff6f18b08b0a2. Resources: {'instances', 'cores', 'ram'} {{(pid=94358) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 21 10:51:31.651720 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-b65aeae9-f9eb-4047-b371-4bc3e487b9bb tempest-ServerAddressesTestJSON-60624113 tempest-ServerAddressesTestJSON-60624113-project] [instance: 29254d77-006b-48f6-b954-eea0279178d3] Selected host: n-h1-811414-3; Selected node: n-h1-811414-3; Alternates: [('n-h2-811414-3', 'n-h2-811414-3')] {{(pid=94358) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 21 10:51:31.653066 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-b65aeae9-f9eb-4047-b371-4bc3e487b9bb tempest-ServerAddressesTestJSON-60624113 tempest-ServerAddressesTestJSON-60624113-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:51:31.653650 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-b65aeae9-f9eb-4047-b371-4bc3e487b9bb tempest-ServerAddressesTestJSON-60624113 tempest-ServerAddressesTestJSON-60624113-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:51:31.661402 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-b3410948-6a31-4d5e-9259-2b1904564cb6 tempest-ListServerFiltersTestJSON-810261055 tempest-ListServerFiltersTestJSON-810261055-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:51:31.662002 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-b3410948-6a31-4d5e-9259-2b1904564cb6 tempest-ListServerFiltersTestJSON-810261055 tempest-ListServerFiltersTestJSON-810261055-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:51:31.664058 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-b65aeae9-f9eb-4047-b371-4bc3e487b9bb tempest-ServerAddressesTestJSON-60624113 tempest-ServerAddressesTestJSON-60624113-project] [instance: 29254d77-006b-48f6-b954-eea0279178d3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f5cdc3d5-9524-4220-a7fc-ab5606975fdb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94358) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 21 10:51:31.666296 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-b65aeae9-f9eb-4047-b371-4bc3e487b9bb tempest-ServerAddressesTestJSON-60624113 tempest-ServerAddressesTestJSON-60624113-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:51:31.666929 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-b65aeae9-f9eb-4047-b371-4bc3e487b9bb tempest-ServerAddressesTestJSON-60624113 tempest-ServerAddressesTestJSON-60624113-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:51:31.718041 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-b65aeae9-f9eb-4047-b371-4bc3e487b9bb tempest-ServerAddressesTestJSON-60624113 tempest-ServerAddressesTestJSON-60624113-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:51:31.719200 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-b65aeae9-f9eb-4047-b371-4bc3e487b9bb tempest-ServerAddressesTestJSON-60624113 tempest-ServerAddressesTestJSON-60624113-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:51:31.719898 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-b3410948-6a31-4d5e-9259-2b1904564cb6 tempest-ListServerFiltersTestJSON-810261055 tempest-ListServerFiltersTestJSON-810261055-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:51:31.720611 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-b3410948-6a31-4d5e-9259-2b1904564cb6 tempest-ListServerFiltersTestJSON-810261055 tempest-ListServerFiltersTestJSON-810261055-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:51:31.721677 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-b3410948-6a31-4d5e-9259-2b1904564cb6 tempest-ListServerFiltersTestJSON-810261055 tempest-ListServerFiltersTestJSON-810261055-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:51:31.722191 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-b3410948-6a31-4d5e-9259-2b1904564cb6 tempest-ListServerFiltersTestJSON-810261055 tempest-ListServerFiltersTestJSON-810261055-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:51:31.741484 n-d-811414-3 nova-conductor[94357]: DEBUG nova.quota [None req-b3410948-6a31-4d5e-9259-2b1904564cb6 tempest-ListServerFiltersTestJSON-810261055 tempest-ListServerFiltersTestJSON-810261055-project] Getting quotas for project 05dc1ec794254a05982d14bb108746a3. Resources: {'instances', 'cores', 'ram'} {{(pid=94357) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 21 10:51:31.746584 n-d-811414-3 nova-conductor[94357]: DEBUG nova.quota [None req-b3410948-6a31-4d5e-9259-2b1904564cb6 tempest-ListServerFiltersTestJSON-810261055 tempest-ListServerFiltersTestJSON-810261055-project] Getting quotas for user 5c164ebfb60e4c528c7d66b62173cf2b and project 05dc1ec794254a05982d14bb108746a3. Resources: {'instances', 'cores', 'ram'} {{(pid=94357) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 21 10:51:31.761068 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-b3410948-6a31-4d5e-9259-2b1904564cb6 tempest-ListServerFiltersTestJSON-810261055 tempest-ListServerFiltersTestJSON-810261055-project] [instance: aa22808e-39b8-472d-aa97-b29a74efe1b5] Selected host: n-h1-811414-3; Selected node: n-h1-811414-3; Alternates: [('n-h2-811414-3', 'n-h2-811414-3')] {{(pid=94357) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 21 10:51:31.762168 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-b3410948-6a31-4d5e-9259-2b1904564cb6 tempest-ListServerFiltersTestJSON-810261055 tempest-ListServerFiltersTestJSON-810261055-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:51:31.762556 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-b3410948-6a31-4d5e-9259-2b1904564cb6 tempest-ListServerFiltersTestJSON-810261055 tempest-ListServerFiltersTestJSON-810261055-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:51:31.772858 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-b3410948-6a31-4d5e-9259-2b1904564cb6 tempest-ListServerFiltersTestJSON-810261055 tempest-ListServerFiltersTestJSON-810261055-project] [instance: aa22808e-39b8-472d-aa97-b29a74efe1b5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f5cdc3d5-9524-4220-a7fc-ab5606975fdb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94357) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 21 10:51:31.774503 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-b3410948-6a31-4d5e-9259-2b1904564cb6 tempest-ListServerFiltersTestJSON-810261055 tempest-ListServerFiltersTestJSON-810261055-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:51:31.775185 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-b3410948-6a31-4d5e-9259-2b1904564cb6 tempest-ListServerFiltersTestJSON-810261055 tempest-ListServerFiltersTestJSON-810261055-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:51:31.812010 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-b3410948-6a31-4d5e-9259-2b1904564cb6 tempest-ListServerFiltersTestJSON-810261055 tempest-ListServerFiltersTestJSON-810261055-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:51:31.813021 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-b3410948-6a31-4d5e-9259-2b1904564cb6 tempest-ListServerFiltersTestJSON-810261055 tempest-ListServerFiltersTestJSON-810261055-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:51:33.512034 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-859dc48e-8b86-4ef0-a0c3-ffde112946fc tempest-ServersOnMultiNodesTest-174179125 tempest-ServersOnMultiNodesTest-174179125-project] Took 0.30 seconds to select destinations for 1 instance(s). {{(pid=94358) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 21 10:51:33.547214 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-859dc48e-8b86-4ef0-a0c3-ffde112946fc tempest-ServersOnMultiNodesTest-174179125 tempest-ServersOnMultiNodesTest-174179125-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:51:33.547770 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-859dc48e-8b86-4ef0-a0c3-ffde112946fc tempest-ServersOnMultiNodesTest-174179125 tempest-ServersOnMultiNodesTest-174179125-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:51:33.604729 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-859dc48e-8b86-4ef0-a0c3-ffde112946fc tempest-ServersOnMultiNodesTest-174179125 tempest-ServersOnMultiNodesTest-174179125-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:51:33.605287 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-859dc48e-8b86-4ef0-a0c3-ffde112946fc tempest-ServersOnMultiNodesTest-174179125 tempest-ServersOnMultiNodesTest-174179125-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:51:33.606135 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-859dc48e-8b86-4ef0-a0c3-ffde112946fc tempest-ServersOnMultiNodesTest-174179125 tempest-ServersOnMultiNodesTest-174179125-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:51:33.606648 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-859dc48e-8b86-4ef0-a0c3-ffde112946fc tempest-ServersOnMultiNodesTest-174179125 tempest-ServersOnMultiNodesTest-174179125-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:51:33.625981 n-d-811414-3 nova-conductor[94358]: DEBUG nova.quota [None req-859dc48e-8b86-4ef0-a0c3-ffde112946fc tempest-ServersOnMultiNodesTest-174179125 tempest-ServersOnMultiNodesTest-174179125-project] Getting quotas for project 2430b168754442d1b4fdbcfa80bfaccd. Resources: {'instances', 'cores', 'ram'} {{(pid=94358) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 21 10:51:33.630894 n-d-811414-3 nova-conductor[94358]: DEBUG nova.quota [None req-859dc48e-8b86-4ef0-a0c3-ffde112946fc tempest-ServersOnMultiNodesTest-174179125 tempest-ServersOnMultiNodesTest-174179125-project] Getting quotas for user 831e8270c33b4193b8d2d4ae2098f5da and project 2430b168754442d1b4fdbcfa80bfaccd. Resources: {'instances', 'cores', 'ram'} {{(pid=94358) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 21 10:51:33.643927 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-859dc48e-8b86-4ef0-a0c3-ffde112946fc tempest-ServersOnMultiNodesTest-174179125 tempest-ServersOnMultiNodesTest-174179125-project] [instance: 88d90bc3-1dc6-4bd5-b321-191717bae448] Selected host: n-h1-811414-3; Selected node: n-h1-811414-3; Alternates: [] {{(pid=94358) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 21 10:51:33.645046 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-859dc48e-8b86-4ef0-a0c3-ffde112946fc tempest-ServersOnMultiNodesTest-174179125 tempest-ServersOnMultiNodesTest-174179125-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:51:33.645448 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-859dc48e-8b86-4ef0-a0c3-ffde112946fc tempest-ServersOnMultiNodesTest-174179125 tempest-ServersOnMultiNodesTest-174179125-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:51:33.653511 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-859dc48e-8b86-4ef0-a0c3-ffde112946fc tempest-ServersOnMultiNodesTest-174179125 tempest-ServersOnMultiNodesTest-174179125-project] [instance: 88d90bc3-1dc6-4bd5-b321-191717bae448] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f5cdc3d5-9524-4220-a7fc-ab5606975fdb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94358) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 21 10:51:33.655940 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-859dc48e-8b86-4ef0-a0c3-ffde112946fc tempest-ServersOnMultiNodesTest-174179125 tempest-ServersOnMultiNodesTest-174179125-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:51:33.656328 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-859dc48e-8b86-4ef0-a0c3-ffde112946fc tempest-ServersOnMultiNodesTest-174179125 tempest-ServersOnMultiNodesTest-174179125-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:51:33.692554 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-859dc48e-8b86-4ef0-a0c3-ffde112946fc tempest-ServersOnMultiNodesTest-174179125 tempest-ServersOnMultiNodesTest-174179125-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:51:33.693136 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-859dc48e-8b86-4ef0-a0c3-ffde112946fc tempest-ServersOnMultiNodesTest-174179125 tempest-ServersOnMultiNodesTest-174179125-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:51:46.745962 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-548b6547-6e35-4cf7-92e8-c88af1dde4ca tempest-ServerDiskConfigTestJSON-900499457 tempest-ServerDiskConfigTestJSON-900499457-project] Took 0.39 seconds to select destinations for 1 instance(s). {{(pid=94357) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 21 10:51:46.779790 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-548b6547-6e35-4cf7-92e8-c88af1dde4ca tempest-ServerDiskConfigTestJSON-900499457 tempest-ServerDiskConfigTestJSON-900499457-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:51:46.780226 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-548b6547-6e35-4cf7-92e8-c88af1dde4ca tempest-ServerDiskConfigTestJSON-900499457 tempest-ServerDiskConfigTestJSON-900499457-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:51:46.844779 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-548b6547-6e35-4cf7-92e8-c88af1dde4ca tempest-ServerDiskConfigTestJSON-900499457 tempest-ServerDiskConfigTestJSON-900499457-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:51:46.845515 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-548b6547-6e35-4cf7-92e8-c88af1dde4ca tempest-ServerDiskConfigTestJSON-900499457 tempest-ServerDiskConfigTestJSON-900499457-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:51:46.846770 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-548b6547-6e35-4cf7-92e8-c88af1dde4ca tempest-ServerDiskConfigTestJSON-900499457 tempest-ServerDiskConfigTestJSON-900499457-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:51:46.847910 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-548b6547-6e35-4cf7-92e8-c88af1dde4ca tempest-ServerDiskConfigTestJSON-900499457 tempest-ServerDiskConfigTestJSON-900499457-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:51:46.882415 n-d-811414-3 nova-conductor[94357]: DEBUG nova.quota [None req-548b6547-6e35-4cf7-92e8-c88af1dde4ca tempest-ServerDiskConfigTestJSON-900499457 tempest-ServerDiskConfigTestJSON-900499457-project] Getting quotas for project 78a902223fa5427fa8674f3c72f167d5. Resources: {'instances', 'cores', 'ram'} {{(pid=94357) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 21 10:51:46.887544 n-d-811414-3 nova-conductor[94357]: DEBUG nova.quota [None req-548b6547-6e35-4cf7-92e8-c88af1dde4ca tempest-ServerDiskConfigTestJSON-900499457 tempest-ServerDiskConfigTestJSON-900499457-project] Getting quotas for user 7e648cbf76134a7cb08ed2747dfcf7c3 and project 78a902223fa5427fa8674f3c72f167d5. Resources: {'instances', 'cores', 'ram'} {{(pid=94357) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 21 10:51:46.905818 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-548b6547-6e35-4cf7-92e8-c88af1dde4ca tempest-ServerDiskConfigTestJSON-900499457 tempest-ServerDiskConfigTestJSON-900499457-project] [instance: 24954394-ed45-4a60-9d3c-0193c6a312b1] Selected host: n-h2-811414-3; Selected node: n-h2-811414-3; Alternates: [('n-h1-811414-3', 'n-h1-811414-3')] {{(pid=94357) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 21 10:51:46.911891 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-548b6547-6e35-4cf7-92e8-c88af1dde4ca tempest-ServerDiskConfigTestJSON-900499457 tempest-ServerDiskConfigTestJSON-900499457-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:51:46.912541 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-548b6547-6e35-4cf7-92e8-c88af1dde4ca tempest-ServerDiskConfigTestJSON-900499457 tempest-ServerDiskConfigTestJSON-900499457-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:51:46.923628 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-548b6547-6e35-4cf7-92e8-c88af1dde4ca tempest-ServerDiskConfigTestJSON-900499457 tempest-ServerDiskConfigTestJSON-900499457-project] [instance: 24954394-ed45-4a60-9d3c-0193c6a312b1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f5cdc3d5-9524-4220-a7fc-ab5606975fdb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94357) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 21 10:51:46.927511 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-548b6547-6e35-4cf7-92e8-c88af1dde4ca tempest-ServerDiskConfigTestJSON-900499457 tempest-ServerDiskConfigTestJSON-900499457-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:51:46.928130 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-548b6547-6e35-4cf7-92e8-c88af1dde4ca tempest-ServerDiskConfigTestJSON-900499457 tempest-ServerDiskConfigTestJSON-900499457-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:51:47.000800 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-548b6547-6e35-4cf7-92e8-c88af1dde4ca tempest-ServerDiskConfigTestJSON-900499457 tempest-ServerDiskConfigTestJSON-900499457-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:51:47.001517 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-548b6547-6e35-4cf7-92e8-c88af1dde4ca tempest-ServerDiskConfigTestJSON-900499457 tempest-ServerDiskConfigTestJSON-900499457-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:51:58.895958 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-85a2229c-2d18-46a9-85ec-e913c19d1c3a tempest-AttachVolumeShelveTestJSON-1979811183 tempest-AttachVolumeShelveTestJSON-1979811183-project] Took 0.33 seconds to select destinations for 1 instance(s). {{(pid=94358) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 21 10:51:58.924528 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-85a2229c-2d18-46a9-85ec-e913c19d1c3a tempest-AttachVolumeShelveTestJSON-1979811183 tempest-AttachVolumeShelveTestJSON-1979811183-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:51:58.925227 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-85a2229c-2d18-46a9-85ec-e913c19d1c3a tempest-AttachVolumeShelveTestJSON-1979811183 tempest-AttachVolumeShelveTestJSON-1979811183-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:51:58.993295 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-85a2229c-2d18-46a9-85ec-e913c19d1c3a tempest-AttachVolumeShelveTestJSON-1979811183 tempest-AttachVolumeShelveTestJSON-1979811183-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:51:58.994068 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-85a2229c-2d18-46a9-85ec-e913c19d1c3a tempest-AttachVolumeShelveTestJSON-1979811183 tempest-AttachVolumeShelveTestJSON-1979811183-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:51:58.994952 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-85a2229c-2d18-46a9-85ec-e913c19d1c3a tempest-AttachVolumeShelveTestJSON-1979811183 tempest-AttachVolumeShelveTestJSON-1979811183-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:51:58.995343 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-85a2229c-2d18-46a9-85ec-e913c19d1c3a tempest-AttachVolumeShelveTestJSON-1979811183 tempest-AttachVolumeShelveTestJSON-1979811183-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:51:59.015808 n-d-811414-3 nova-conductor[94358]: DEBUG nova.quota [None req-85a2229c-2d18-46a9-85ec-e913c19d1c3a tempest-AttachVolumeShelveTestJSON-1979811183 tempest-AttachVolumeShelveTestJSON-1979811183-project] Getting quotas for project 7fe7231048fa4ae0a6a535d61b711f18. Resources: {'instances', 'cores', 'ram'} {{(pid=94358) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 21 10:51:59.031490 n-d-811414-3 nova-conductor[94358]: DEBUG nova.quota [None req-85a2229c-2d18-46a9-85ec-e913c19d1c3a tempest-AttachVolumeShelveTestJSON-1979811183 tempest-AttachVolumeShelveTestJSON-1979811183-project] Getting quotas for user c5a931b4d7804504a5eee6ca0c13e0e0 and project 7fe7231048fa4ae0a6a535d61b711f18. Resources: {'instances', 'cores', 'ram'} {{(pid=94358) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 21 10:51:59.057505 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-85a2229c-2d18-46a9-85ec-e913c19d1c3a tempest-AttachVolumeShelveTestJSON-1979811183 tempest-AttachVolumeShelveTestJSON-1979811183-project] [instance: f0c88cb2-ae97-4416-aacb-29e8610de677] Selected host: n-h1-811414-3; Selected node: n-h1-811414-3; Alternates: [('n-h2-811414-3', 'n-h2-811414-3')] {{(pid=94358) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 21 10:51:59.059015 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-85a2229c-2d18-46a9-85ec-e913c19d1c3a tempest-AttachVolumeShelveTestJSON-1979811183 tempest-AttachVolumeShelveTestJSON-1979811183-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:51:59.063202 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-85a2229c-2d18-46a9-85ec-e913c19d1c3a tempest-AttachVolumeShelveTestJSON-1979811183 tempest-AttachVolumeShelveTestJSON-1979811183-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:51:59.071919 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-85a2229c-2d18-46a9-85ec-e913c19d1c3a tempest-AttachVolumeShelveTestJSON-1979811183 tempest-AttachVolumeShelveTestJSON-1979811183-project] [instance: f0c88cb2-ae97-4416-aacb-29e8610de677] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f5cdc3d5-9524-4220-a7fc-ab5606975fdb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94358) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 21 10:51:59.073338 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-85a2229c-2d18-46a9-85ec-e913c19d1c3a tempest-AttachVolumeShelveTestJSON-1979811183 tempest-AttachVolumeShelveTestJSON-1979811183-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:51:59.073901 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-85a2229c-2d18-46a9-85ec-e913c19d1c3a tempest-AttachVolumeShelveTestJSON-1979811183 tempest-AttachVolumeShelveTestJSON-1979811183-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:51:59.122967 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-85a2229c-2d18-46a9-85ec-e913c19d1c3a tempest-AttachVolumeShelveTestJSON-1979811183 tempest-AttachVolumeShelveTestJSON-1979811183-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:51:59.123961 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-85a2229c-2d18-46a9-85ec-e913c19d1c3a tempest-AttachVolumeShelveTestJSON-1979811183 tempest-AttachVolumeShelveTestJSON-1979811183-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:52:11.333732 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-8fb54b6c-94d8-46ca-be91-6f3f7201e0ea tempest-ServersOnMultiNodesTest-174179125 tempest-ServersOnMultiNodesTest-174179125-project] Took 0.33 seconds to select destinations for 1 instance(s). {{(pid=94357) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 21 10:52:11.357450 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-8fb54b6c-94d8-46ca-be91-6f3f7201e0ea tempest-ServersOnMultiNodesTest-174179125 tempest-ServersOnMultiNodesTest-174179125-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:52:11.357858 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-8fb54b6c-94d8-46ca-be91-6f3f7201e0ea tempest-ServersOnMultiNodesTest-174179125 tempest-ServersOnMultiNodesTest-174179125-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:52:11.390573 n-d-811414-3 nova-conductor[94357]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 21 10:52:11.406134 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-8fb54b6c-94d8-46ca-be91-6f3f7201e0ea tempest-ServersOnMultiNodesTest-174179125 tempest-ServersOnMultiNodesTest-174179125-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:52:11.406599 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-8fb54b6c-94d8-46ca-be91-6f3f7201e0ea tempest-ServersOnMultiNodesTest-174179125 tempest-ServersOnMultiNodesTest-174179125-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:52:11.407362 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-8fb54b6c-94d8-46ca-be91-6f3f7201e0ea tempest-ServersOnMultiNodesTest-174179125 tempest-ServersOnMultiNodesTest-174179125-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:52:11.407757 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-8fb54b6c-94d8-46ca-be91-6f3f7201e0ea tempest-ServersOnMultiNodesTest-174179125 tempest-ServersOnMultiNodesTest-174179125-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:52:11.425151 n-d-811414-3 nova-conductor[94357]: DEBUG nova.quota [None req-8fb54b6c-94d8-46ca-be91-6f3f7201e0ea tempest-ServersOnMultiNodesTest-174179125 tempest-ServersOnMultiNodesTest-174179125-project] Getting quotas for project 2430b168754442d1b4fdbcfa80bfaccd. Resources: {'instances', 'cores', 'ram'} {{(pid=94357) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 21 10:52:11.429753 n-d-811414-3 nova-conductor[94357]: DEBUG nova.quota [None req-8fb54b6c-94d8-46ca-be91-6f3f7201e0ea tempest-ServersOnMultiNodesTest-174179125 tempest-ServersOnMultiNodesTest-174179125-project] Getting quotas for user 831e8270c33b4193b8d2d4ae2098f5da and project 2430b168754442d1b4fdbcfa80bfaccd. Resources: {'instances', 'cores', 'ram'} {{(pid=94357) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 21 10:52:11.441584 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-8fb54b6c-94d8-46ca-be91-6f3f7201e0ea tempest-ServersOnMultiNodesTest-174179125 tempest-ServersOnMultiNodesTest-174179125-project] [instance: e34101c6-2146-4ced-bd56-3a8b612b66ec] Selected host: n-h2-811414-3; Selected node: n-h2-811414-3; Alternates: [] {{(pid=94357) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 21 10:52:11.442572 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-8fb54b6c-94d8-46ca-be91-6f3f7201e0ea tempest-ServersOnMultiNodesTest-174179125 tempest-ServersOnMultiNodesTest-174179125-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:52:11.443097 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-8fb54b6c-94d8-46ca-be91-6f3f7201e0ea tempest-ServersOnMultiNodesTest-174179125 tempest-ServersOnMultiNodesTest-174179125-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:52:11.450010 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-8fb54b6c-94d8-46ca-be91-6f3f7201e0ea tempest-ServersOnMultiNodesTest-174179125 tempest-ServersOnMultiNodesTest-174179125-project] [instance: e34101c6-2146-4ced-bd56-3a8b612b66ec] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f5cdc3d5-9524-4220-a7fc-ab5606975fdb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94357) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 21 10:52:11.451571 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-8fb54b6c-94d8-46ca-be91-6f3f7201e0ea tempest-ServersOnMultiNodesTest-174179125 tempest-ServersOnMultiNodesTest-174179125-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:52:11.451977 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-8fb54b6c-94d8-46ca-be91-6f3f7201e0ea tempest-ServersOnMultiNodesTest-174179125 tempest-ServersOnMultiNodesTest-174179125-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:52:11.477879 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-8fb54b6c-94d8-46ca-be91-6f3f7201e0ea tempest-ServersOnMultiNodesTest-174179125 tempest-ServersOnMultiNodesTest-174179125-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:52:11.478286 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-8fb54b6c-94d8-46ca-be91-6f3f7201e0ea tempest-ServersOnMultiNodesTest-174179125 tempest-ServersOnMultiNodesTest-174179125-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:52:16.968364 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-9678e9c2-e380-4a11-bc18-5c9616100134 tempest-ServerShowV254Test-1763195738 tempest-ServerShowV254Test-1763195738-project] Took 0.26 seconds to select destinations for 1 instance(s). {{(pid=94358) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 21 10:52:16.990668 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-9678e9c2-e380-4a11-bc18-5c9616100134 tempest-ServerShowV254Test-1763195738 tempest-ServerShowV254Test-1763195738-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:52:16.991082 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-9678e9c2-e380-4a11-bc18-5c9616100134 tempest-ServerShowV254Test-1763195738 tempest-ServerShowV254Test-1763195738-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:52:17.065549 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-9678e9c2-e380-4a11-bc18-5c9616100134 tempest-ServerShowV254Test-1763195738 tempest-ServerShowV254Test-1763195738-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:52:17.066155 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-9678e9c2-e380-4a11-bc18-5c9616100134 tempest-ServerShowV254Test-1763195738 tempest-ServerShowV254Test-1763195738-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:52:17.067048 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-9678e9c2-e380-4a11-bc18-5c9616100134 tempest-ServerShowV254Test-1763195738 tempest-ServerShowV254Test-1763195738-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:52:17.067440 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-9678e9c2-e380-4a11-bc18-5c9616100134 tempest-ServerShowV254Test-1763195738 tempest-ServerShowV254Test-1763195738-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:52:17.087173 n-d-811414-3 nova-conductor[94358]: DEBUG nova.quota [None req-9678e9c2-e380-4a11-bc18-5c9616100134 tempest-ServerShowV254Test-1763195738 tempest-ServerShowV254Test-1763195738-project] Getting quotas for project 1f86d4fda143448bb91e9d6b5f6ae0c3. Resources: {'instances', 'cores', 'ram'} {{(pid=94358) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 21 10:52:17.093322 n-d-811414-3 nova-conductor[94358]: DEBUG nova.quota [None req-9678e9c2-e380-4a11-bc18-5c9616100134 tempest-ServerShowV254Test-1763195738 tempest-ServerShowV254Test-1763195738-project] Getting quotas for user e8df4e1340ec437a8f2e59178c839aa8 and project 1f86d4fda143448bb91e9d6b5f6ae0c3. Resources: {'instances', 'cores', 'ram'} {{(pid=94358) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 21 10:52:17.106950 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-9678e9c2-e380-4a11-bc18-5c9616100134 tempest-ServerShowV254Test-1763195738 tempest-ServerShowV254Test-1763195738-project] [instance: a8b3ccb5-6e32-4492-a774-2e254d4745a7] Selected host: n-h2-811414-3; Selected node: n-h2-811414-3; Alternates: [('n-h1-811414-3', 'n-h1-811414-3')] {{(pid=94358) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 21 10:52:17.107963 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-9678e9c2-e380-4a11-bc18-5c9616100134 tempest-ServerShowV254Test-1763195738 tempest-ServerShowV254Test-1763195738-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:52:17.108369 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-9678e9c2-e380-4a11-bc18-5c9616100134 tempest-ServerShowV254Test-1763195738 tempest-ServerShowV254Test-1763195738-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:52:17.116072 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-9678e9c2-e380-4a11-bc18-5c9616100134 tempest-ServerShowV254Test-1763195738 tempest-ServerShowV254Test-1763195738-project] [instance: a8b3ccb5-6e32-4492-a774-2e254d4745a7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f5cdc3d5-9524-4220-a7fc-ab5606975fdb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94358) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 21 10:52:17.117465 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-9678e9c2-e380-4a11-bc18-5c9616100134 tempest-ServerShowV254Test-1763195738 tempest-ServerShowV254Test-1763195738-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:52:17.117902 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-9678e9c2-e380-4a11-bc18-5c9616100134 tempest-ServerShowV254Test-1763195738 tempest-ServerShowV254Test-1763195738-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:52:17.156837 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-9678e9c2-e380-4a11-bc18-5c9616100134 tempest-ServerShowV254Test-1763195738 tempest-ServerShowV254Test-1763195738-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:52:17.157356 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-9678e9c2-e380-4a11-bc18-5c9616100134 tempest-ServerShowV254Test-1763195738 tempest-ServerShowV254Test-1763195738-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:52:17.989885 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-33682f9d-0ceb-4b02-b27e-a9717a303072 tempest-ServersNegativeTestJSON-703029332 tempest-ServersNegativeTestJSON-703029332-project] Targeting cell 6c99d8ec-fb48-48af-b02b-a629a7c2cb6b(cell1) for conductor method unshelve_instance {{(pid=94357) wrapper /opt/stack/nova/nova/conductor/manager.py:91}} Apr 21 10:52:17.990395 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-33682f9d-0ceb-4b02-b27e-a9717a303072 tempest-ServersNegativeTestJSON-703029332 tempest-ServersNegativeTestJSON-703029332-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:52:17.991925 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-33682f9d-0ceb-4b02-b27e-a9717a303072 tempest-ServersNegativeTestJSON-703029332 tempest-ServersNegativeTestJSON-703029332-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:52:18.838452 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-33682f9d-0ceb-4b02-b27e-a9717a303072 tempest-ServersNegativeTestJSON-703029332 tempest-ServersNegativeTestJSON-703029332-project] [instance: 99ea8b69-c986-4acc-a604-c7db07129f1e] Requesting cell 6c99d8ec-fb48-48af-b02b-a629a7c2cb6b(cell1) during scheduling {{(pid=94357) _restrict_request_spec_to_cell /opt/stack/nova/nova/conductor/manager.py:902}} Apr 21 10:52:19.180951 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-33682f9d-0ceb-4b02-b27e-a9717a303072 tempest-ServersNegativeTestJSON-703029332 tempest-ServersNegativeTestJSON-703029332-project] Took 0.33 seconds to select destinations for 1 instance(s). {{(pid=94357) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 21 10:52:19.190877 n-d-811414-3 nova-conductor[94357]: DEBUG nova.objects.instance [None req-33682f9d-0ceb-4b02-b27e-a9717a303072 tempest-ServersNegativeTestJSON-703029332 tempest-ServersNegativeTestJSON-703029332-project] Lazy-loading 'flavor' on Instance uuid 99ea8b69-c986-4acc-a604-c7db07129f1e {{(pid=94357) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Apr 21 10:52:20.189757 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-dc9cb276-1cd2-4a5c-8374-82199b7bdb0b tempest-ServerAddressesNegativeTestJSON-1682402086 tempest-ServerAddressesNegativeTestJSON-1682402086-project] Took 0.32 seconds to select destinations for 1 instance(s). {{(pid=94358) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 21 10:52:20.212985 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-dc9cb276-1cd2-4a5c-8374-82199b7bdb0b tempest-ServerAddressesNegativeTestJSON-1682402086 tempest-ServerAddressesNegativeTestJSON-1682402086-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:52:20.213688 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-dc9cb276-1cd2-4a5c-8374-82199b7bdb0b tempest-ServerAddressesNegativeTestJSON-1682402086 tempest-ServerAddressesNegativeTestJSON-1682402086-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:52:20.282650 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-dc9cb276-1cd2-4a5c-8374-82199b7bdb0b tempest-ServerAddressesNegativeTestJSON-1682402086 tempest-ServerAddressesNegativeTestJSON-1682402086-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:52:20.283138 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-dc9cb276-1cd2-4a5c-8374-82199b7bdb0b tempest-ServerAddressesNegativeTestJSON-1682402086 tempest-ServerAddressesNegativeTestJSON-1682402086-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:52:20.283933 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-dc9cb276-1cd2-4a5c-8374-82199b7bdb0b tempest-ServerAddressesNegativeTestJSON-1682402086 tempest-ServerAddressesNegativeTestJSON-1682402086-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:52:20.284255 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-dc9cb276-1cd2-4a5c-8374-82199b7bdb0b tempest-ServerAddressesNegativeTestJSON-1682402086 tempest-ServerAddressesNegativeTestJSON-1682402086-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:52:20.310473 n-d-811414-3 nova-conductor[94358]: DEBUG nova.quota [None req-dc9cb276-1cd2-4a5c-8374-82199b7bdb0b tempest-ServerAddressesNegativeTestJSON-1682402086 tempest-ServerAddressesNegativeTestJSON-1682402086-project] Getting quotas for project 6c3132bc272640ef8789f83d6264a90a. Resources: {'instances', 'cores', 'ram'} {{(pid=94358) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 21 10:52:20.315198 n-d-811414-3 nova-conductor[94358]: DEBUG nova.quota [None req-dc9cb276-1cd2-4a5c-8374-82199b7bdb0b tempest-ServerAddressesNegativeTestJSON-1682402086 tempest-ServerAddressesNegativeTestJSON-1682402086-project] Getting quotas for user e67ee415c90e49849e871386cd1a55ff and project 6c3132bc272640ef8789f83d6264a90a. Resources: {'instances', 'cores', 'ram'} {{(pid=94358) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 21 10:52:20.349056 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-dc9cb276-1cd2-4a5c-8374-82199b7bdb0b tempest-ServerAddressesNegativeTestJSON-1682402086 tempest-ServerAddressesNegativeTestJSON-1682402086-project] [instance: 8148d56b-3195-4dcf-8421-2bf15ad636c0] Selected host: n-h1-811414-3; Selected node: n-h1-811414-3; Alternates: [('n-h2-811414-3', 'n-h2-811414-3')] {{(pid=94358) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 21 10:52:20.349056 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-dc9cb276-1cd2-4a5c-8374-82199b7bdb0b tempest-ServerAddressesNegativeTestJSON-1682402086 tempest-ServerAddressesNegativeTestJSON-1682402086-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:52:20.349056 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-dc9cb276-1cd2-4a5c-8374-82199b7bdb0b tempest-ServerAddressesNegativeTestJSON-1682402086 tempest-ServerAddressesNegativeTestJSON-1682402086-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:52:20.357358 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-dc9cb276-1cd2-4a5c-8374-82199b7bdb0b tempest-ServerAddressesNegativeTestJSON-1682402086 tempest-ServerAddressesNegativeTestJSON-1682402086-project] [instance: 8148d56b-3195-4dcf-8421-2bf15ad636c0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f5cdc3d5-9524-4220-a7fc-ab5606975fdb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94358) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 21 10:52:20.357358 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-dc9cb276-1cd2-4a5c-8374-82199b7bdb0b tempest-ServerAddressesNegativeTestJSON-1682402086 tempest-ServerAddressesNegativeTestJSON-1682402086-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:52:20.357358 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-dc9cb276-1cd2-4a5c-8374-82199b7bdb0b tempest-ServerAddressesNegativeTestJSON-1682402086 tempest-ServerAddressesNegativeTestJSON-1682402086-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:52:20.383819 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-dc9cb276-1cd2-4a5c-8374-82199b7bdb0b tempest-ServerAddressesNegativeTestJSON-1682402086 tempest-ServerAddressesNegativeTestJSON-1682402086-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:52:20.384774 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-dc9cb276-1cd2-4a5c-8374-82199b7bdb0b tempest-ServerAddressesNegativeTestJSON-1682402086 tempest-ServerAddressesNegativeTestJSON-1682402086-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:52:23.907191 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-5495a8f6-22c6-468d-b7b6-83d8a9c0feee tempest-ServerShowV254Test-1763195738 tempest-ServerShowV254Test-1763195738-project] Targeting cell 6c99d8ec-fb48-48af-b02b-a629a7c2cb6b(cell1) for conductor method rebuild_instance {{(pid=94357) wrapper /opt/stack/nova/nova/conductor/manager.py:91}} Apr 21 10:52:23.911602 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-5495a8f6-22c6-468d-b7b6-83d8a9c0feee tempest-ServerShowV254Test-1763195738 tempest-ServerShowV254Test-1763195738-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:52:23.912371 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-5495a8f6-22c6-468d-b7b6-83d8a9c0feee tempest-ServerShowV254Test-1763195738 tempest-ServerShowV254Test-1763195738-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:52:23.943982 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-5495a8f6-22c6-468d-b7b6-83d8a9c0feee tempest-ServerShowV254Test-1763195738 tempest-ServerShowV254Test-1763195738-project] [instance: a8b3ccb5-6e32-4492-a774-2e254d4745a7] No migration record for the rebuild/evacuate request. {{(pid=94357) rebuild_instance /opt/stack/nova/nova/conductor/manager.py:1101}} Apr 21 10:52:24.002902 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_db.api [None req-5495a8f6-22c6-468d-b7b6-83d8a9c0feee tempest-ServerShowV254Test-1763195738 tempest-ServerShowV254Test-1763195738-project] DB error: (pymysql.err.OperationalError) (1213, 'Deadlock found when trying to get lock; try restarting transaction') Apr 21 10:52:24.002902 n-d-811414-3 nova-conductor[94357]: [SQL: UPDATE instance_actions SET updated_at=%(updated_at)s WHERE instance_actions.id = %(instance_actions_id)s] Apr 21 10:52:24.002902 n-d-811414-3 nova-conductor[94357]: [parameters: {'updated_at': datetime.datetime(2022, 4, 21, 10, 52, 23, 976436), 'instance_actions_id': 228}] Apr 21 10:52:24.002902 n-d-811414-3 nova-conductor[94357]: (Background on this error at: http://sqlalche.me/e/13/e3q8) {{(pid=94357) _is_exception_expected /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:184}} Apr 21 10:52:24.007418 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_db.api [None req-5495a8f6-22c6-468d-b7b6-83d8a9c0feee tempest-ServerShowV254Test-1763195738 tempest-ServerShowV254Test-1763195738-project] Performing DB retry for function nova.db.sqlalchemy.api.action_event_finish {{(pid=94357) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Apr 21 10:52:58.289129 n-d-811414-3 nova-conductor[94358]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 21 10:52:59.594740 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-e89ff67e-5301-4527-99ee-7346d016359e tempest-ServerRescueNegativeTestJSON-536859065 tempest-ServerRescueNegativeTestJSON-536859065-project] Took 0.45 seconds to select destinations for 1 instance(s). {{(pid=94358) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 21 10:52:59.645456 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-e89ff67e-5301-4527-99ee-7346d016359e tempest-ServerRescueNegativeTestJSON-536859065 tempest-ServerRescueNegativeTestJSON-536859065-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:52:59.645812 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-e89ff67e-5301-4527-99ee-7346d016359e tempest-ServerRescueNegativeTestJSON-536859065 tempest-ServerRescueNegativeTestJSON-536859065-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:52:59.755935 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-e89ff67e-5301-4527-99ee-7346d016359e tempest-ServerRescueNegativeTestJSON-536859065 tempest-ServerRescueNegativeTestJSON-536859065-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:52:59.756324 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-e89ff67e-5301-4527-99ee-7346d016359e tempest-ServerRescueNegativeTestJSON-536859065 tempest-ServerRescueNegativeTestJSON-536859065-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:52:59.757088 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-e89ff67e-5301-4527-99ee-7346d016359e tempest-ServerRescueNegativeTestJSON-536859065 tempest-ServerRescueNegativeTestJSON-536859065-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:52:59.757495 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-e89ff67e-5301-4527-99ee-7346d016359e tempest-ServerRescueNegativeTestJSON-536859065 tempest-ServerRescueNegativeTestJSON-536859065-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:52:59.775414 n-d-811414-3 nova-conductor[94358]: DEBUG nova.quota [None req-e89ff67e-5301-4527-99ee-7346d016359e tempest-ServerRescueNegativeTestJSON-536859065 tempest-ServerRescueNegativeTestJSON-536859065-project] Getting quotas for project b74d0904703046bfa1480275c0c4cb2d. Resources: {'instances', 'cores', 'ram'} {{(pid=94358) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 21 10:52:59.786195 n-d-811414-3 nova-conductor[94358]: DEBUG nova.quota [None req-e89ff67e-5301-4527-99ee-7346d016359e tempest-ServerRescueNegativeTestJSON-536859065 tempest-ServerRescueNegativeTestJSON-536859065-project] Getting quotas for user 18e20f053212456da4638a380bb5240b and project b74d0904703046bfa1480275c0c4cb2d. Resources: {'instances', 'cores', 'ram'} {{(pid=94358) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 21 10:52:59.799152 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-e89ff67e-5301-4527-99ee-7346d016359e tempest-ServerRescueNegativeTestJSON-536859065 tempest-ServerRescueNegativeTestJSON-536859065-project] [instance: f2e2cb6c-97c1-49e7-a33f-664b725d1d42] Selected host: n-h2-811414-3; Selected node: n-h2-811414-3; Alternates: [('n-h1-811414-3', 'n-h1-811414-3')] {{(pid=94358) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 21 10:52:59.800368 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-e89ff67e-5301-4527-99ee-7346d016359e tempest-ServerRescueNegativeTestJSON-536859065 tempest-ServerRescueNegativeTestJSON-536859065-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:52:59.800992 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-e89ff67e-5301-4527-99ee-7346d016359e tempest-ServerRescueNegativeTestJSON-536859065 tempest-ServerRescueNegativeTestJSON-536859065-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:52:59.809867 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-e89ff67e-5301-4527-99ee-7346d016359e tempest-ServerRescueNegativeTestJSON-536859065 tempest-ServerRescueNegativeTestJSON-536859065-project] [instance: f2e2cb6c-97c1-49e7-a33f-664b725d1d42] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f5cdc3d5-9524-4220-a7fc-ab5606975fdb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94358) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 21 10:52:59.811674 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-e89ff67e-5301-4527-99ee-7346d016359e tempest-ServerRescueNegativeTestJSON-536859065 tempest-ServerRescueNegativeTestJSON-536859065-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:52:59.812249 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-e89ff67e-5301-4527-99ee-7346d016359e tempest-ServerRescueNegativeTestJSON-536859065 tempest-ServerRescueNegativeTestJSON-536859065-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:52:59.870638 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-e89ff67e-5301-4527-99ee-7346d016359e tempest-ServerRescueNegativeTestJSON-536859065 tempest-ServerRescueNegativeTestJSON-536859065-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:52:59.871436 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-e89ff67e-5301-4527-99ee-7346d016359e tempest-ServerRescueNegativeTestJSON-536859065 tempest-ServerRescueNegativeTestJSON-536859065-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:53:04.306225 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-0b9a9f11-6af8-4d27-a97a-749f8c9c7219 tempest-ServerRescueNegativeTestJSON-536859065 tempest-ServerRescueNegativeTestJSON-536859065-project] Took 0.47 seconds to select destinations for 1 instance(s). {{(pid=94357) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 21 10:53:04.375684 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-0b9a9f11-6af8-4d27-a97a-749f8c9c7219 tempest-ServerRescueNegativeTestJSON-536859065 tempest-ServerRescueNegativeTestJSON-536859065-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:53:04.378140 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-0b9a9f11-6af8-4d27-a97a-749f8c9c7219 tempest-ServerRescueNegativeTestJSON-536859065 tempest-ServerRescueNegativeTestJSON-536859065-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:53:04.460276 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-0b9a9f11-6af8-4d27-a97a-749f8c9c7219 tempest-ServerRescueNegativeTestJSON-536859065 tempest-ServerRescueNegativeTestJSON-536859065-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:53:04.461039 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-0b9a9f11-6af8-4d27-a97a-749f8c9c7219 tempest-ServerRescueNegativeTestJSON-536859065 tempest-ServerRescueNegativeTestJSON-536859065-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:53:04.462177 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-0b9a9f11-6af8-4d27-a97a-749f8c9c7219 tempest-ServerRescueNegativeTestJSON-536859065 tempest-ServerRescueNegativeTestJSON-536859065-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:53:04.462785 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-0b9a9f11-6af8-4d27-a97a-749f8c9c7219 tempest-ServerRescueNegativeTestJSON-536859065 tempest-ServerRescueNegativeTestJSON-536859065-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:53:04.484597 n-d-811414-3 nova-conductor[94357]: DEBUG nova.quota [None req-0b9a9f11-6af8-4d27-a97a-749f8c9c7219 tempest-ServerRescueNegativeTestJSON-536859065 tempest-ServerRescueNegativeTestJSON-536859065-project] Getting quotas for project b74d0904703046bfa1480275c0c4cb2d. Resources: {'instances', 'cores', 'ram'} {{(pid=94357) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 21 10:53:04.493287 n-d-811414-3 nova-conductor[94357]: DEBUG nova.quota [None req-0b9a9f11-6af8-4d27-a97a-749f8c9c7219 tempest-ServerRescueNegativeTestJSON-536859065 tempest-ServerRescueNegativeTestJSON-536859065-project] Getting quotas for user 18e20f053212456da4638a380bb5240b and project b74d0904703046bfa1480275c0c4cb2d. Resources: {'instances', 'cores', 'ram'} {{(pid=94357) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 21 10:53:04.507504 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-0b9a9f11-6af8-4d27-a97a-749f8c9c7219 tempest-ServerRescueNegativeTestJSON-536859065 tempest-ServerRescueNegativeTestJSON-536859065-project] [instance: 20659da2-d2a4-404e-9428-15d3dc143d4d] Selected host: n-h2-811414-3; Selected node: n-h2-811414-3; Alternates: [('n-h1-811414-3', 'n-h1-811414-3')] {{(pid=94357) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 21 10:53:04.508954 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-0b9a9f11-6af8-4d27-a97a-749f8c9c7219 tempest-ServerRescueNegativeTestJSON-536859065 tempest-ServerRescueNegativeTestJSON-536859065-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:53:04.509608 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-0b9a9f11-6af8-4d27-a97a-749f8c9c7219 tempest-ServerRescueNegativeTestJSON-536859065 tempest-ServerRescueNegativeTestJSON-536859065-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:53:04.523279 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-0b9a9f11-6af8-4d27-a97a-749f8c9c7219 tempest-ServerRescueNegativeTestJSON-536859065 tempest-ServerRescueNegativeTestJSON-536859065-project] [instance: 20659da2-d2a4-404e-9428-15d3dc143d4d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f5cdc3d5-9524-4220-a7fc-ab5606975fdb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94357) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 21 10:53:04.527403 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-0b9a9f11-6af8-4d27-a97a-749f8c9c7219 tempest-ServerRescueNegativeTestJSON-536859065 tempest-ServerRescueNegativeTestJSON-536859065-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:53:04.527403 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-0b9a9f11-6af8-4d27-a97a-749f8c9c7219 tempest-ServerRescueNegativeTestJSON-536859065 tempest-ServerRescueNegativeTestJSON-536859065-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:53:04.593441 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-0b9a9f11-6af8-4d27-a97a-749f8c9c7219 tempest-ServerRescueNegativeTestJSON-536859065 tempest-ServerRescueNegativeTestJSON-536859065-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:53:04.593984 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-0b9a9f11-6af8-4d27-a97a-749f8c9c7219 tempest-ServerRescueNegativeTestJSON-536859065 tempest-ServerRescueNegativeTestJSON-536859065-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:53:33.968475 n-d-811414-3 nova-conductor[94358]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f60095b5-b68f-459e-af9a-3776dcd48c13] AMQP server on 10.222.0.13:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 21 10:53:34.981059 n-d-811414-3 nova-conductor[94358]: INFO oslo.messaging._drivers.impl_rabbit [-] [f60095b5-b68f-459e-af9a-3776dcd48c13] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 54064. Apr 21 10:54:09.136369 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-43190199-c4c4-4621-8211-9518e92b5d68 tempest-ServerGroupTestJSON-544051342 tempest-ServerGroupTestJSON-544051342-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:54:09.136369 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-43190199-c4c4-4621-8211-9518e92b5d68 tempest-ServerGroupTestJSON-544051342 tempest-ServerGroupTestJSON-544051342-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:54:10.178133 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-43190199-c4c4-4621-8211-9518e92b5d68 tempest-ServerGroupTestJSON-544051342 tempest-ServerGroupTestJSON-544051342-project] Took 0.93 seconds to select destinations for 1 instance(s). {{(pid=94358) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 21 10:54:10.286873 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-43190199-c4c4-4621-8211-9518e92b5d68 tempest-ServerGroupTestJSON-544051342 tempest-ServerGroupTestJSON-544051342-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:54:10.287579 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-43190199-c4c4-4621-8211-9518e92b5d68 tempest-ServerGroupTestJSON-544051342 tempest-ServerGroupTestJSON-544051342-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:54:10.396437 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-43190199-c4c4-4621-8211-9518e92b5d68 tempest-ServerGroupTestJSON-544051342 tempest-ServerGroupTestJSON-544051342-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:54:10.396437 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-43190199-c4c4-4621-8211-9518e92b5d68 tempest-ServerGroupTestJSON-544051342 tempest-ServerGroupTestJSON-544051342-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:54:10.396437 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-43190199-c4c4-4621-8211-9518e92b5d68 tempest-ServerGroupTestJSON-544051342 tempest-ServerGroupTestJSON-544051342-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:54:10.396437 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-43190199-c4c4-4621-8211-9518e92b5d68 tempest-ServerGroupTestJSON-544051342 tempest-ServerGroupTestJSON-544051342-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:54:10.430149 n-d-811414-3 nova-conductor[94358]: DEBUG nova.quota [None req-43190199-c4c4-4621-8211-9518e92b5d68 tempest-ServerGroupTestJSON-544051342 tempest-ServerGroupTestJSON-544051342-project] Getting quotas for project 922875b0c2d54868825ef2efbf72a4ab. Resources: {'instances', 'cores', 'ram'} {{(pid=94358) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 21 10:54:10.443949 n-d-811414-3 nova-conductor[94358]: DEBUG nova.quota [None req-43190199-c4c4-4621-8211-9518e92b5d68 tempest-ServerGroupTestJSON-544051342 tempest-ServerGroupTestJSON-544051342-project] Getting quotas for user 397bdfa6c6274f038c82df5544da7fd5 and project 922875b0c2d54868825ef2efbf72a4ab. Resources: {'instances', 'cores', 'ram'} {{(pid=94358) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 21 10:54:10.478781 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-43190199-c4c4-4621-8211-9518e92b5d68 tempest-ServerGroupTestJSON-544051342 tempest-ServerGroupTestJSON-544051342-project] [instance: 2faab9a3-3690-4e35-8638-f2e0f38f66ad] Selected host: n-h1-811414-3; Selected node: n-h1-811414-3; Alternates: [('n-h2-811414-3', 'n-h2-811414-3')] {{(pid=94358) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 21 10:54:10.480855 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-43190199-c4c4-4621-8211-9518e92b5d68 tempest-ServerGroupTestJSON-544051342 tempest-ServerGroupTestJSON-544051342-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:54:10.481827 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-43190199-c4c4-4621-8211-9518e92b5d68 tempest-ServerGroupTestJSON-544051342 tempest-ServerGroupTestJSON-544051342-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:54:10.502568 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-43190199-c4c4-4621-8211-9518e92b5d68 tempest-ServerGroupTestJSON-544051342 tempest-ServerGroupTestJSON-544051342-project] [instance: 2faab9a3-3690-4e35-8638-f2e0f38f66ad] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f5cdc3d5-9524-4220-a7fc-ab5606975fdb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94358) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 21 10:54:10.504317 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-43190199-c4c4-4621-8211-9518e92b5d68 tempest-ServerGroupTestJSON-544051342 tempest-ServerGroupTestJSON-544051342-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:54:10.505049 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-43190199-c4c4-4621-8211-9518e92b5d68 tempest-ServerGroupTestJSON-544051342 tempest-ServerGroupTestJSON-544051342-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:54:10.584427 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-43190199-c4c4-4621-8211-9518e92b5d68 tempest-ServerGroupTestJSON-544051342 tempest-ServerGroupTestJSON-544051342-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:54:10.586032 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-43190199-c4c4-4621-8211-9518e92b5d68 tempest-ServerGroupTestJSON-544051342 tempest-ServerGroupTestJSON-544051342-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:54:18.771937 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-519186d4-f5b5-48cf-bc39-98fdf06a5063 tempest-AttachVolumeShelveTestJSON-1979811183 tempest-AttachVolumeShelveTestJSON-1979811183-project] Targeting cell 6c99d8ec-fb48-48af-b02b-a629a7c2cb6b(cell1) for conductor method unshelve_instance {{(pid=94357) wrapper /opt/stack/nova/nova/conductor/manager.py:91}} Apr 21 10:54:18.773102 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-519186d4-f5b5-48cf-bc39-98fdf06a5063 tempest-AttachVolumeShelveTestJSON-1979811183 tempest-AttachVolumeShelveTestJSON-1979811183-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:54:18.774240 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-519186d4-f5b5-48cf-bc39-98fdf06a5063 tempest-AttachVolumeShelveTestJSON-1979811183 tempest-AttachVolumeShelveTestJSON-1979811183-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:54:19.533166 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-519186d4-f5b5-48cf-bc39-98fdf06a5063 tempest-AttachVolumeShelveTestJSON-1979811183 tempest-AttachVolumeShelveTestJSON-1979811183-project] [instance: f0c88cb2-ae97-4416-aacb-29e8610de677] Requesting cell 6c99d8ec-fb48-48af-b02b-a629a7c2cb6b(cell1) during scheduling {{(pid=94357) _restrict_request_spec_to_cell /opt/stack/nova/nova/conductor/manager.py:902}} Apr 21 10:54:19.903033 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-519186d4-f5b5-48cf-bc39-98fdf06a5063 tempest-AttachVolumeShelveTestJSON-1979811183 tempest-AttachVolumeShelveTestJSON-1979811183-project] Took 0.35 seconds to select destinations for 1 instance(s). {{(pid=94357) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 21 10:54:19.911996 n-d-811414-3 nova-conductor[94357]: DEBUG nova.objects.instance [None req-519186d4-f5b5-48cf-bc39-98fdf06a5063 tempest-AttachVolumeShelveTestJSON-1979811183 tempest-AttachVolumeShelveTestJSON-1979811183-project] Lazy-loading 'flavor' on Instance uuid f0c88cb2-ae97-4416-aacb-29e8610de677 {{(pid=94357) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Apr 21 10:54:20.760763 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-efedd61e-e935-4a26-b61a-a7f95c1e7e4f tempest-ServersNegativeTestMultiTenantJSON-1137831065 tempest-ServersNegativeTestMultiTenantJSON-1137831065-project] Took 0.60 seconds to select destinations for 1 instance(s). {{(pid=94358) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 21 10:54:20.824644 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-efedd61e-e935-4a26-b61a-a7f95c1e7e4f tempest-ServersNegativeTestMultiTenantJSON-1137831065 tempest-ServersNegativeTestMultiTenantJSON-1137831065-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:54:20.825052 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-efedd61e-e935-4a26-b61a-a7f95c1e7e4f tempest-ServersNegativeTestMultiTenantJSON-1137831065 tempest-ServersNegativeTestMultiTenantJSON-1137831065-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:54:20.970044 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-efedd61e-e935-4a26-b61a-a7f95c1e7e4f tempest-ServersNegativeTestMultiTenantJSON-1137831065 tempest-ServersNegativeTestMultiTenantJSON-1137831065-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:54:20.970291 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-efedd61e-e935-4a26-b61a-a7f95c1e7e4f tempest-ServersNegativeTestMultiTenantJSON-1137831065 tempest-ServersNegativeTestMultiTenantJSON-1137831065-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:54:20.970979 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-efedd61e-e935-4a26-b61a-a7f95c1e7e4f tempest-ServersNegativeTestMultiTenantJSON-1137831065 tempest-ServersNegativeTestMultiTenantJSON-1137831065-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:54:20.971369 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-efedd61e-e935-4a26-b61a-a7f95c1e7e4f tempest-ServersNegativeTestMultiTenantJSON-1137831065 tempest-ServersNegativeTestMultiTenantJSON-1137831065-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:54:21.005801 n-d-811414-3 nova-conductor[94358]: DEBUG nova.quota [None req-efedd61e-e935-4a26-b61a-a7f95c1e7e4f tempest-ServersNegativeTestMultiTenantJSON-1137831065 tempest-ServersNegativeTestMultiTenantJSON-1137831065-project] Getting quotas for project 1e9930e4552949d99bb59f8548477717. Resources: {'instances', 'cores', 'ram'} {{(pid=94358) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 21 10:54:21.022168 n-d-811414-3 nova-conductor[94358]: DEBUG nova.quota [None req-efedd61e-e935-4a26-b61a-a7f95c1e7e4f tempest-ServersNegativeTestMultiTenantJSON-1137831065 tempest-ServersNegativeTestMultiTenantJSON-1137831065-project] Getting quotas for user 2bd6f985b8434bdb8254b1fd0ce269bb and project 1e9930e4552949d99bb59f8548477717. Resources: {'instances', 'cores', 'ram'} {{(pid=94358) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 21 10:54:21.068083 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-efedd61e-e935-4a26-b61a-a7f95c1e7e4f tempest-ServersNegativeTestMultiTenantJSON-1137831065 tempest-ServersNegativeTestMultiTenantJSON-1137831065-project] [instance: 4df54f85-c861-4a7f-bdce-98d01142625a] Selected host: n-h1-811414-3; Selected node: n-h1-811414-3; Alternates: [('n-h2-811414-3', 'n-h2-811414-3')] {{(pid=94358) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 21 10:54:21.074187 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-efedd61e-e935-4a26-b61a-a7f95c1e7e4f tempest-ServersNegativeTestMultiTenantJSON-1137831065 tempest-ServersNegativeTestMultiTenantJSON-1137831065-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:54:21.077173 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-efedd61e-e935-4a26-b61a-a7f95c1e7e4f tempest-ServersNegativeTestMultiTenantJSON-1137831065 tempest-ServersNegativeTestMultiTenantJSON-1137831065-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:54:21.091969 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-efedd61e-e935-4a26-b61a-a7f95c1e7e4f tempest-ServersNegativeTestMultiTenantJSON-1137831065 tempest-ServersNegativeTestMultiTenantJSON-1137831065-project] [instance: 4df54f85-c861-4a7f-bdce-98d01142625a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f5cdc3d5-9524-4220-a7fc-ab5606975fdb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94358) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 21 10:54:21.094334 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-efedd61e-e935-4a26-b61a-a7f95c1e7e4f tempest-ServersNegativeTestMultiTenantJSON-1137831065 tempest-ServersNegativeTestMultiTenantJSON-1137831065-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:54:21.096429 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-efedd61e-e935-4a26-b61a-a7f95c1e7e4f tempest-ServersNegativeTestMultiTenantJSON-1137831065 tempest-ServersNegativeTestMultiTenantJSON-1137831065-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:54:21.181548 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-efedd61e-e935-4a26-b61a-a7f95c1e7e4f tempest-ServersNegativeTestMultiTenantJSON-1137831065 tempest-ServersNegativeTestMultiTenantJSON-1137831065-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:54:21.182527 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-efedd61e-e935-4a26-b61a-a7f95c1e7e4f tempest-ServersNegativeTestMultiTenantJSON-1137831065 tempest-ServersNegativeTestMultiTenantJSON-1137831065-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:54:30.218631 n-d-811414-3 nova-conductor[94357]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6404cb3a-bdc9-481c-93a6-d63501b53d9b] AMQP server on 10.222.0.13:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Apr 21 10:54:31.231032 n-d-811414-3 nova-conductor[94357]: INFO oslo.messaging._drivers.impl_rabbit [-] [6404cb3a-bdc9-481c-93a6-d63501b53d9b] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 55178. Apr 21 10:54:42.836761 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-364e8d8a-b00b-48d3-b1bf-1832dedaf0ab tempest-AttachSCSIVolumeTestJSON-1714965896 tempest-AttachSCSIVolumeTestJSON-1714965896-project] Took 0.34 seconds to select destinations for 1 instance(s). {{(pid=94357) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 21 10:54:42.881706 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-364e8d8a-b00b-48d3-b1bf-1832dedaf0ab tempest-AttachSCSIVolumeTestJSON-1714965896 tempest-AttachSCSIVolumeTestJSON-1714965896-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:54:42.882328 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-364e8d8a-b00b-48d3-b1bf-1832dedaf0ab tempest-AttachSCSIVolumeTestJSON-1714965896 tempest-AttachSCSIVolumeTestJSON-1714965896-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:54:43.003660 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-364e8d8a-b00b-48d3-b1bf-1832dedaf0ab tempest-AttachSCSIVolumeTestJSON-1714965896 tempest-AttachSCSIVolumeTestJSON-1714965896-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:54:43.004066 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-364e8d8a-b00b-48d3-b1bf-1832dedaf0ab tempest-AttachSCSIVolumeTestJSON-1714965896 tempest-AttachSCSIVolumeTestJSON-1714965896-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:54:43.005022 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-364e8d8a-b00b-48d3-b1bf-1832dedaf0ab tempest-AttachSCSIVolumeTestJSON-1714965896 tempest-AttachSCSIVolumeTestJSON-1714965896-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:54:43.005579 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-364e8d8a-b00b-48d3-b1bf-1832dedaf0ab tempest-AttachSCSIVolumeTestJSON-1714965896 tempest-AttachSCSIVolumeTestJSON-1714965896-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:54:43.025708 n-d-811414-3 nova-conductor[94357]: DEBUG nova.quota [None req-364e8d8a-b00b-48d3-b1bf-1832dedaf0ab tempest-AttachSCSIVolumeTestJSON-1714965896 tempest-AttachSCSIVolumeTestJSON-1714965896-project] Getting quotas for project 6c1a63850e87465196002550a65f19f6. Resources: {'instances', 'cores', 'ram'} {{(pid=94357) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 21 10:54:43.031284 n-d-811414-3 nova-conductor[94357]: DEBUG nova.quota [None req-364e8d8a-b00b-48d3-b1bf-1832dedaf0ab tempest-AttachSCSIVolumeTestJSON-1714965896 tempest-AttachSCSIVolumeTestJSON-1714965896-project] Getting quotas for user 91ff2ea816b54b95a2a5c78451a934ff and project 6c1a63850e87465196002550a65f19f6. Resources: {'instances', 'cores', 'ram'} {{(pid=94357) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 21 10:54:43.049599 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-364e8d8a-b00b-48d3-b1bf-1832dedaf0ab tempest-AttachSCSIVolumeTestJSON-1714965896 tempest-AttachSCSIVolumeTestJSON-1714965896-project] [instance: b4640714-274e-49f2-8233-15abbad4d6c7] Selected host: n-h2-811414-3; Selected node: n-h2-811414-3; Alternates: [('n-h1-811414-3', 'n-h1-811414-3')] {{(pid=94357) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 21 10:54:43.050574 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-364e8d8a-b00b-48d3-b1bf-1832dedaf0ab tempest-AttachSCSIVolumeTestJSON-1714965896 tempest-AttachSCSIVolumeTestJSON-1714965896-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:54:43.050983 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-364e8d8a-b00b-48d3-b1bf-1832dedaf0ab tempest-AttachSCSIVolumeTestJSON-1714965896 tempest-AttachSCSIVolumeTestJSON-1714965896-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:54:43.070996 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-364e8d8a-b00b-48d3-b1bf-1832dedaf0ab tempest-AttachSCSIVolumeTestJSON-1714965896 tempest-AttachSCSIVolumeTestJSON-1714965896-project] [instance: b4640714-274e-49f2-8233-15abbad4d6c7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='56a1a5d8-ee54-47ac-bf30-c4d9536bd408',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94357) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 21 10:54:43.073568 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-364e8d8a-b00b-48d3-b1bf-1832dedaf0ab tempest-AttachSCSIVolumeTestJSON-1714965896 tempest-AttachSCSIVolumeTestJSON-1714965896-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:54:43.073984 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-364e8d8a-b00b-48d3-b1bf-1832dedaf0ab tempest-AttachSCSIVolumeTestJSON-1714965896 tempest-AttachSCSIVolumeTestJSON-1714965896-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:54:43.129924 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-364e8d8a-b00b-48d3-b1bf-1832dedaf0ab tempest-AttachSCSIVolumeTestJSON-1714965896 tempest-AttachSCSIVolumeTestJSON-1714965896-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:54:43.130389 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-364e8d8a-b00b-48d3-b1bf-1832dedaf0ab tempest-AttachSCSIVolumeTestJSON-1714965896 tempest-AttachSCSIVolumeTestJSON-1714965896-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:55:00.080364 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-79fbe3b0-fd9c-4265-a544-7d1e6391c4fa tempest-ServerRescueNegativeTestJSON-536859065 tempest-ServerRescueNegativeTestJSON-536859065-project] Took 0.30 seconds to select destinations for 1 instance(s). {{(pid=94358) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 21 10:55:00.142881 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-79fbe3b0-fd9c-4265-a544-7d1e6391c4fa tempest-ServerRescueNegativeTestJSON-536859065 tempest-ServerRescueNegativeTestJSON-536859065-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:55:00.143206 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-79fbe3b0-fd9c-4265-a544-7d1e6391c4fa tempest-ServerRescueNegativeTestJSON-536859065 tempest-ServerRescueNegativeTestJSON-536859065-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:55:00.332046 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-79fbe3b0-fd9c-4265-a544-7d1e6391c4fa tempest-ServerRescueNegativeTestJSON-536859065 tempest-ServerRescueNegativeTestJSON-536859065-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:55:00.332879 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-79fbe3b0-fd9c-4265-a544-7d1e6391c4fa tempest-ServerRescueNegativeTestJSON-536859065 tempest-ServerRescueNegativeTestJSON-536859065-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:55:00.335704 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-79fbe3b0-fd9c-4265-a544-7d1e6391c4fa tempest-ServerRescueNegativeTestJSON-536859065 tempest-ServerRescueNegativeTestJSON-536859065-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:55:00.338968 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-79fbe3b0-fd9c-4265-a544-7d1e6391c4fa tempest-ServerRescueNegativeTestJSON-536859065 tempest-ServerRescueNegativeTestJSON-536859065-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:55:00.374338 n-d-811414-3 nova-conductor[94358]: DEBUG nova.quota [None req-79fbe3b0-fd9c-4265-a544-7d1e6391c4fa tempest-ServerRescueNegativeTestJSON-536859065 tempest-ServerRescueNegativeTestJSON-536859065-project] Getting quotas for project b74d0904703046bfa1480275c0c4cb2d. Resources: {'instances', 'cores', 'ram'} {{(pid=94358) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 21 10:55:00.384354 n-d-811414-3 nova-conductor[94358]: DEBUG nova.quota [None req-79fbe3b0-fd9c-4265-a544-7d1e6391c4fa tempest-ServerRescueNegativeTestJSON-536859065 tempest-ServerRescueNegativeTestJSON-536859065-project] Getting quotas for user 18e20f053212456da4638a380bb5240b and project b74d0904703046bfa1480275c0c4cb2d. Resources: {'instances', 'cores', 'ram'} {{(pid=94358) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 21 10:55:00.410768 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-79fbe3b0-fd9c-4265-a544-7d1e6391c4fa tempest-ServerRescueNegativeTestJSON-536859065 tempest-ServerRescueNegativeTestJSON-536859065-project] [instance: 5172d036-2386-4fd8-8e33-893a508d3c33] Selected host: n-h1-811414-3; Selected node: n-h1-811414-3; Alternates: [('n-h2-811414-3', 'n-h2-811414-3')] {{(pid=94358) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 21 10:55:00.411954 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-79fbe3b0-fd9c-4265-a544-7d1e6391c4fa tempest-ServerRescueNegativeTestJSON-536859065 tempest-ServerRescueNegativeTestJSON-536859065-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:55:00.414329 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-79fbe3b0-fd9c-4265-a544-7d1e6391c4fa tempest-ServerRescueNegativeTestJSON-536859065 tempest-ServerRescueNegativeTestJSON-536859065-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:55:00.442247 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-79fbe3b0-fd9c-4265-a544-7d1e6391c4fa tempest-ServerRescueNegativeTestJSON-536859065 tempest-ServerRescueNegativeTestJSON-536859065-project] [instance: 5172d036-2386-4fd8-8e33-893a508d3c33] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f5cdc3d5-9524-4220-a7fc-ab5606975fdb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94358) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 21 10:55:00.444514 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-79fbe3b0-fd9c-4265-a544-7d1e6391c4fa tempest-ServerRescueNegativeTestJSON-536859065 tempest-ServerRescueNegativeTestJSON-536859065-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:55:00.445735 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-79fbe3b0-fd9c-4265-a544-7d1e6391c4fa tempest-ServerRescueNegativeTestJSON-536859065 tempest-ServerRescueNegativeTestJSON-536859065-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:55:00.510853 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-79fbe3b0-fd9c-4265-a544-7d1e6391c4fa tempest-ServerRescueNegativeTestJSON-536859065 tempest-ServerRescueNegativeTestJSON-536859065-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:55:00.511825 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-79fbe3b0-fd9c-4265-a544-7d1e6391c4fa tempest-ServerRescueNegativeTestJSON-536859065 tempest-ServerRescueNegativeTestJSON-536859065-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:55:31.403139 n-d-811414-3 nova-conductor[94357]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 21 10:55:51.454397 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-b94e1c69-a65b-4a32-937d-43878f46fbf9 tempest-AttachVolumeShelveTestJSON-1979811183 tempest-AttachVolumeShelveTestJSON-1979811183-project] Took 0.42 seconds to select destinations for 1 instance(s). {{(pid=94357) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 21 10:55:51.503255 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-b94e1c69-a65b-4a32-937d-43878f46fbf9 tempest-AttachVolumeShelveTestJSON-1979811183 tempest-AttachVolumeShelveTestJSON-1979811183-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:55:51.503255 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-b94e1c69-a65b-4a32-937d-43878f46fbf9 tempest-AttachVolumeShelveTestJSON-1979811183 tempest-AttachVolumeShelveTestJSON-1979811183-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:55:51.601571 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-b94e1c69-a65b-4a32-937d-43878f46fbf9 tempest-AttachVolumeShelveTestJSON-1979811183 tempest-AttachVolumeShelveTestJSON-1979811183-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:55:51.602004 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-b94e1c69-a65b-4a32-937d-43878f46fbf9 tempest-AttachVolumeShelveTestJSON-1979811183 tempest-AttachVolumeShelveTestJSON-1979811183-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:55:51.602769 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-b94e1c69-a65b-4a32-937d-43878f46fbf9 tempest-AttachVolumeShelveTestJSON-1979811183 tempest-AttachVolumeShelveTestJSON-1979811183-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:55:51.603168 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-b94e1c69-a65b-4a32-937d-43878f46fbf9 tempest-AttachVolumeShelveTestJSON-1979811183 tempest-AttachVolumeShelveTestJSON-1979811183-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:55:51.624125 n-d-811414-3 nova-conductor[94357]: DEBUG nova.quota [None req-b94e1c69-a65b-4a32-937d-43878f46fbf9 tempest-AttachVolumeShelveTestJSON-1979811183 tempest-AttachVolumeShelveTestJSON-1979811183-project] Getting quotas for project 7fe7231048fa4ae0a6a535d61b711f18. Resources: {'instances', 'cores', 'ram'} {{(pid=94357) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 21 10:55:51.630370 n-d-811414-3 nova-conductor[94357]: DEBUG nova.quota [None req-b94e1c69-a65b-4a32-937d-43878f46fbf9 tempest-AttachVolumeShelveTestJSON-1979811183 tempest-AttachVolumeShelveTestJSON-1979811183-project] Getting quotas for user c5a931b4d7804504a5eee6ca0c13e0e0 and project 7fe7231048fa4ae0a6a535d61b711f18. Resources: {'instances', 'cores', 'ram'} {{(pid=94357) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 21 10:55:51.659138 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-b94e1c69-a65b-4a32-937d-43878f46fbf9 tempest-AttachVolumeShelveTestJSON-1979811183 tempest-AttachVolumeShelveTestJSON-1979811183-project] [instance: 0931c442-7832-46c4-bea9-7d97e042720e] Selected host: n-h2-811414-3; Selected node: n-h2-811414-3; Alternates: [('n-h1-811414-3', 'n-h1-811414-3')] {{(pid=94357) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 21 10:55:51.660509 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-b94e1c69-a65b-4a32-937d-43878f46fbf9 tempest-AttachVolumeShelveTestJSON-1979811183 tempest-AttachVolumeShelveTestJSON-1979811183-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:55:51.661138 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-b94e1c69-a65b-4a32-937d-43878f46fbf9 tempest-AttachVolumeShelveTestJSON-1979811183 tempest-AttachVolumeShelveTestJSON-1979811183-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:55:51.678457 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-b94e1c69-a65b-4a32-937d-43878f46fbf9 tempest-AttachVolumeShelveTestJSON-1979811183 tempest-AttachVolumeShelveTestJSON-1979811183-project] [instance: 0931c442-7832-46c4-bea9-7d97e042720e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f5cdc3d5-9524-4220-a7fc-ab5606975fdb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94357) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 21 10:55:51.680956 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-b94e1c69-a65b-4a32-937d-43878f46fbf9 tempest-AttachVolumeShelveTestJSON-1979811183 tempest-AttachVolumeShelveTestJSON-1979811183-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:55:51.681532 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-b94e1c69-a65b-4a32-937d-43878f46fbf9 tempest-AttachVolumeShelveTestJSON-1979811183 tempest-AttachVolumeShelveTestJSON-1979811183-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:55:51.731951 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-b94e1c69-a65b-4a32-937d-43878f46fbf9 tempest-AttachVolumeShelveTestJSON-1979811183 tempest-AttachVolumeShelveTestJSON-1979811183-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:55:51.735985 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-b94e1c69-a65b-4a32-937d-43878f46fbf9 tempest-AttachVolumeShelveTestJSON-1979811183 tempest-AttachVolumeShelveTestJSON-1979811183-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:56:18.298066 n-d-811414-3 nova-conductor[94358]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 21 10:56:34.979451 n-d-811414-3 nova-conductor[94358]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f60095b5-b68f-459e-af9a-3776dcd48c13] AMQP server on 10.222.0.13:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Apr 21 10:56:35.988825 n-d-811414-3 nova-conductor[94358]: INFO oslo.messaging._drivers.impl_rabbit [-] [f60095b5-b68f-459e-af9a-3776dcd48c13] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 58516. Apr 21 10:57:18.443526 n-d-811414-3 nova-conductor[94358]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f74a9f7c-07ff-404c-aef6-df527a438fd3] AMQP server on 10.222.0.13:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 21 10:57:19.456871 n-d-811414-3 nova-conductor[94358]: INFO oslo.messaging._drivers.impl_rabbit [-] [f74a9f7c-07ff-404c-aef6-df527a438fd3] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 59820. Apr 21 10:57:29.281789 n-d-811414-3 nova-conductor[94358]: ERROR oslo.messaging._drivers.impl_rabbit [-] [764b4c1f-4a95-4767-989c-d3f562ce3759] AMQP server on 10.222.0.13:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 21 10:57:30.299202 n-d-811414-3 nova-conductor[94358]: INFO oslo.messaging._drivers.impl_rabbit [-] [764b4c1f-4a95-4767-989c-d3f562ce3759] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 60204. Apr 21 10:57:31.233816 n-d-811414-3 nova-conductor[94357]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6404cb3a-bdc9-481c-93a6-d63501b53d9b] AMQP server on 10.222.0.13:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 21 10:57:32.243481 n-d-811414-3 nova-conductor[94357]: INFO oslo.messaging._drivers.impl_rabbit [-] [6404cb3a-bdc9-481c-93a6-d63501b53d9b] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 60252. Apr 21 10:57:46.178186 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-36bcd5d9-312a-4190-a3cf-a705851efee8 tempest-AttachVolumeShelveTestJSON-1979811183 tempest-AttachVolumeShelveTestJSON-1979811183-project] Targeting cell 6c99d8ec-fb48-48af-b02b-a629a7c2cb6b(cell1) for conductor method unshelve_instance {{(pid=94357) wrapper /opt/stack/nova/nova/conductor/manager.py:91}} Apr 21 10:57:46.178802 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-36bcd5d9-312a-4190-a3cf-a705851efee8 tempest-AttachVolumeShelveTestJSON-1979811183 tempest-AttachVolumeShelveTestJSON-1979811183-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:57:46.179075 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-36bcd5d9-312a-4190-a3cf-a705851efee8 tempest-AttachVolumeShelveTestJSON-1979811183 tempest-AttachVolumeShelveTestJSON-1979811183-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:57:47.590379 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-36bcd5d9-312a-4190-a3cf-a705851efee8 tempest-AttachVolumeShelveTestJSON-1979811183 tempest-AttachVolumeShelveTestJSON-1979811183-project] [instance: 0931c442-7832-46c4-bea9-7d97e042720e] Requesting cell 6c99d8ec-fb48-48af-b02b-a629a7c2cb6b(cell1) during scheduling {{(pid=94357) _restrict_request_spec_to_cell /opt/stack/nova/nova/conductor/manager.py:902}} Apr 21 10:57:47.991745 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-36bcd5d9-312a-4190-a3cf-a705851efee8 tempest-AttachVolumeShelveTestJSON-1979811183 tempest-AttachVolumeShelveTestJSON-1979811183-project] Took 0.39 seconds to select destinations for 1 instance(s). {{(pid=94357) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 21 10:57:48.003059 n-d-811414-3 nova-conductor[94357]: DEBUG nova.objects.instance [None req-36bcd5d9-312a-4190-a3cf-a705851efee8 tempest-AttachVolumeShelveTestJSON-1979811183 tempest-AttachVolumeShelveTestJSON-1979811183-project] Lazy-loading 'flavor' on Instance uuid 0931c442-7832-46c4-bea9-7d97e042720e {{(pid=94357) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Apr 21 10:58:18.489812 n-d-811414-3 nova-conductor[94358]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 21 10:58:32.274763 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-628d6884-19a2-4b86-a88c-73db4a750194 tempest-ServerTagsTestJSON-1214220290 tempest-ServerTagsTestJSON-1214220290-project] Took 0.41 seconds to select destinations for 1 instance(s). {{(pid=94358) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 21 10:58:32.340480 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-628d6884-19a2-4b86-a88c-73db4a750194 tempest-ServerTagsTestJSON-1214220290 tempest-ServerTagsTestJSON-1214220290-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:58:32.340854 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-628d6884-19a2-4b86-a88c-73db4a750194 tempest-ServerTagsTestJSON-1214220290 tempest-ServerTagsTestJSON-1214220290-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:58:32.466270 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-628d6884-19a2-4b86-a88c-73db4a750194 tempest-ServerTagsTestJSON-1214220290 tempest-ServerTagsTestJSON-1214220290-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:58:32.466675 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-628d6884-19a2-4b86-a88c-73db4a750194 tempest-ServerTagsTestJSON-1214220290 tempest-ServerTagsTestJSON-1214220290-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:58:32.467938 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-628d6884-19a2-4b86-a88c-73db4a750194 tempest-ServerTagsTestJSON-1214220290 tempest-ServerTagsTestJSON-1214220290-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:58:32.472701 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-628d6884-19a2-4b86-a88c-73db4a750194 tempest-ServerTagsTestJSON-1214220290 tempest-ServerTagsTestJSON-1214220290-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:58:32.494149 n-d-811414-3 nova-conductor[94358]: DEBUG nova.quota [None req-628d6884-19a2-4b86-a88c-73db4a750194 tempest-ServerTagsTestJSON-1214220290 tempest-ServerTagsTestJSON-1214220290-project] Getting quotas for project 80db0f92b09d4889ab50a5727d71af00. Resources: {'instances', 'cores', 'ram'} {{(pid=94358) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 21 10:58:32.504561 n-d-811414-3 nova-conductor[94358]: DEBUG nova.quota [None req-628d6884-19a2-4b86-a88c-73db4a750194 tempest-ServerTagsTestJSON-1214220290 tempest-ServerTagsTestJSON-1214220290-project] Getting quotas for user 67c7e8bcf0d04561be4f1fff2a83fb88 and project 80db0f92b09d4889ab50a5727d71af00. Resources: {'instances', 'cores', 'ram'} {{(pid=94358) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 21 10:58:32.533245 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-628d6884-19a2-4b86-a88c-73db4a750194 tempest-ServerTagsTestJSON-1214220290 tempest-ServerTagsTestJSON-1214220290-project] [instance: 577e80c8-21a1-4c0b-9f4e-60b6d49e5538] Selected host: n-h1-811414-3; Selected node: n-h1-811414-3; Alternates: [('n-h2-811414-3', 'n-h2-811414-3')] {{(pid=94358) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 21 10:58:32.536099 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-628d6884-19a2-4b86-a88c-73db4a750194 tempest-ServerTagsTestJSON-1214220290 tempest-ServerTagsTestJSON-1214220290-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:58:32.537855 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-628d6884-19a2-4b86-a88c-73db4a750194 tempest-ServerTagsTestJSON-1214220290 tempest-ServerTagsTestJSON-1214220290-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:58:32.553499 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-628d6884-19a2-4b86-a88c-73db4a750194 tempest-ServerTagsTestJSON-1214220290 tempest-ServerTagsTestJSON-1214220290-project] [instance: 577e80c8-21a1-4c0b-9f4e-60b6d49e5538] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f5cdc3d5-9524-4220-a7fc-ab5606975fdb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94358) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 21 10:58:32.555593 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-628d6884-19a2-4b86-a88c-73db4a750194 tempest-ServerTagsTestJSON-1214220290 tempest-ServerTagsTestJSON-1214220290-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:58:32.556099 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-628d6884-19a2-4b86-a88c-73db4a750194 tempest-ServerTagsTestJSON-1214220290 tempest-ServerTagsTestJSON-1214220290-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:58:32.614751 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-628d6884-19a2-4b86-a88c-73db4a750194 tempest-ServerTagsTestJSON-1214220290 tempest-ServerTagsTestJSON-1214220290-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:58:32.615219 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-628d6884-19a2-4b86-a88c-73db4a750194 tempest-ServerTagsTestJSON-1214220290 tempest-ServerTagsTestJSON-1214220290-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:58:51.413228 n-d-811414-3 nova-conductor[94357]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 21 10:58:52.445503 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-95db181b-c28e-40f8-978e-1d43946c625d tempest-ServerRescueTestJSON-52466693 tempest-ServerRescueTestJSON-52466693-project] Took 0.55 seconds to select destinations for 1 instance(s). {{(pid=94357) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 21 10:58:52.521230 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-95db181b-c28e-40f8-978e-1d43946c625d tempest-ServerRescueTestJSON-52466693 tempest-ServerRescueTestJSON-52466693-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:58:52.522300 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-95db181b-c28e-40f8-978e-1d43946c625d tempest-ServerRescueTestJSON-52466693 tempest-ServerRescueTestJSON-52466693-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:58:52.645376 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-95db181b-c28e-40f8-978e-1d43946c625d tempest-ServerRescueTestJSON-52466693 tempest-ServerRescueTestJSON-52466693-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:58:52.646152 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-95db181b-c28e-40f8-978e-1d43946c625d tempest-ServerRescueTestJSON-52466693 tempest-ServerRescueTestJSON-52466693-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:58:52.647136 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-95db181b-c28e-40f8-978e-1d43946c625d tempest-ServerRescueTestJSON-52466693 tempest-ServerRescueTestJSON-52466693-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:58:52.649501 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-95db181b-c28e-40f8-978e-1d43946c625d tempest-ServerRescueTestJSON-52466693 tempest-ServerRescueTestJSON-52466693-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:58:52.720410 n-d-811414-3 nova-conductor[94357]: DEBUG nova.quota [None req-95db181b-c28e-40f8-978e-1d43946c625d tempest-ServerRescueTestJSON-52466693 tempest-ServerRescueTestJSON-52466693-project] Getting quotas for project 876ee59c4e6c42a5ae837b43ba0b154a. Resources: {'instances', 'cores', 'ram'} {{(pid=94357) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 21 10:58:52.745531 n-d-811414-3 nova-conductor[94357]: DEBUG nova.quota [None req-95db181b-c28e-40f8-978e-1d43946c625d tempest-ServerRescueTestJSON-52466693 tempest-ServerRescueTestJSON-52466693-project] Getting quotas for user b27b3cd91cba4bf7b8b6d01c59deaa89 and project 876ee59c4e6c42a5ae837b43ba0b154a. Resources: {'instances', 'cores', 'ram'} {{(pid=94357) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 21 10:58:52.814221 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-95db181b-c28e-40f8-978e-1d43946c625d tempest-ServerRescueTestJSON-52466693 tempest-ServerRescueTestJSON-52466693-project] [instance: 916f0f49-dae3-465a-87f3-3fb4650b36ad] Selected host: n-h2-811414-3; Selected node: n-h2-811414-3; Alternates: [('n-h1-811414-3', 'n-h1-811414-3')] {{(pid=94357) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 21 10:58:52.815351 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-95db181b-c28e-40f8-978e-1d43946c625d tempest-ServerRescueTestJSON-52466693 tempest-ServerRescueTestJSON-52466693-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:58:52.815850 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-95db181b-c28e-40f8-978e-1d43946c625d tempest-ServerRescueTestJSON-52466693 tempest-ServerRescueTestJSON-52466693-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:58:52.845098 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-95db181b-c28e-40f8-978e-1d43946c625d tempest-ServerRescueTestJSON-52466693 tempest-ServerRescueTestJSON-52466693-project] [instance: 916f0f49-dae3-465a-87f3-3fb4650b36ad] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f5cdc3d5-9524-4220-a7fc-ab5606975fdb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94357) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 21 10:58:52.846532 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-95db181b-c28e-40f8-978e-1d43946c625d tempest-ServerRescueTestJSON-52466693 tempest-ServerRescueTestJSON-52466693-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:58:52.847207 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-95db181b-c28e-40f8-978e-1d43946c625d tempest-ServerRescueTestJSON-52466693 tempest-ServerRescueTestJSON-52466693-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:58:52.934104 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-95db181b-c28e-40f8-978e-1d43946c625d tempest-ServerRescueTestJSON-52466693 tempest-ServerRescueTestJSON-52466693-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:58:52.934584 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-95db181b-c28e-40f8-978e-1d43946c625d tempest-ServerRescueTestJSON-52466693 tempest-ServerRescueTestJSON-52466693-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:59:20.948810 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-43b288ca-f00b-4888-926c-57f001d3be47 tempest-ServerShowV257Test-926576958 tempest-ServerShowV257Test-926576958-project] Took 0.90 seconds to select destinations for 1 instance(s). {{(pid=94358) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 21 10:59:20.990964 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-43b288ca-f00b-4888-926c-57f001d3be47 tempest-ServerShowV257Test-926576958 tempest-ServerShowV257Test-926576958-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:59:20.991372 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-43b288ca-f00b-4888-926c-57f001d3be47 tempest-ServerShowV257Test-926576958 tempest-ServerShowV257Test-926576958-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:59:21.078450 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-43b288ca-f00b-4888-926c-57f001d3be47 tempest-ServerShowV257Test-926576958 tempest-ServerShowV257Test-926576958-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:59:21.078851 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-43b288ca-f00b-4888-926c-57f001d3be47 tempest-ServerShowV257Test-926576958 tempest-ServerShowV257Test-926576958-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:59:21.079571 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-43b288ca-f00b-4888-926c-57f001d3be47 tempest-ServerShowV257Test-926576958 tempest-ServerShowV257Test-926576958-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:59:21.079961 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-43b288ca-f00b-4888-926c-57f001d3be47 tempest-ServerShowV257Test-926576958 tempest-ServerShowV257Test-926576958-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:59:21.110276 n-d-811414-3 nova-conductor[94358]: DEBUG nova.quota [None req-43b288ca-f00b-4888-926c-57f001d3be47 tempest-ServerShowV257Test-926576958 tempest-ServerShowV257Test-926576958-project] Getting quotas for project 0a80c3f18fa8471888ef9f41a0e0c39a. Resources: {'instances', 'cores', 'ram'} {{(pid=94358) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 21 10:59:21.115395 n-d-811414-3 nova-conductor[94358]: DEBUG nova.quota [None req-43b288ca-f00b-4888-926c-57f001d3be47 tempest-ServerShowV257Test-926576958 tempest-ServerShowV257Test-926576958-project] Getting quotas for user ddbbe24176b84f4faf73911fe3380cf0 and project 0a80c3f18fa8471888ef9f41a0e0c39a. Resources: {'instances', 'cores', 'ram'} {{(pid=94358) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 21 10:59:21.150597 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-43b288ca-f00b-4888-926c-57f001d3be47 tempest-ServerShowV257Test-926576958 tempest-ServerShowV257Test-926576958-project] [instance: f03f679a-55ff-4ba8-8f2c-008c20bc2856] Selected host: n-h1-811414-3; Selected node: n-h1-811414-3; Alternates: [('n-h2-811414-3', 'n-h2-811414-3')] {{(pid=94358) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 21 10:59:21.152049 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-43b288ca-f00b-4888-926c-57f001d3be47 tempest-ServerShowV257Test-926576958 tempest-ServerShowV257Test-926576958-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:59:21.174712 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-43b288ca-f00b-4888-926c-57f001d3be47 tempest-ServerShowV257Test-926576958 tempest-ServerShowV257Test-926576958-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:59:21.192053 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-43b288ca-f00b-4888-926c-57f001d3be47 tempest-ServerShowV257Test-926576958 tempest-ServerShowV257Test-926576958-project] [instance: f03f679a-55ff-4ba8-8f2c-008c20bc2856] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f5cdc3d5-9524-4220-a7fc-ab5606975fdb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94358) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 21 10:59:21.193801 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-43b288ca-f00b-4888-926c-57f001d3be47 tempest-ServerShowV257Test-926576958 tempest-ServerShowV257Test-926576958-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:59:21.194354 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-43b288ca-f00b-4888-926c-57f001d3be47 tempest-ServerShowV257Test-926576958 tempest-ServerShowV257Test-926576958-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:59:21.237755 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-43b288ca-f00b-4888-926c-57f001d3be47 tempest-ServerShowV257Test-926576958 tempest-ServerShowV257Test-926576958-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:59:21.238389 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-43b288ca-f00b-4888-926c-57f001d3be47 tempest-ServerShowV257Test-926576958 tempest-ServerShowV257Test-926576958-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:59:27.132718 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-b22fefa5-a7d6-4ca8-ba60-2c174065ce3c tempest-ServerShowV257Test-926576958 tempest-ServerShowV257Test-926576958-project] Targeting cell 6c99d8ec-fb48-48af-b02b-a629a7c2cb6b(cell1) for conductor method rebuild_instance {{(pid=94357) wrapper /opt/stack/nova/nova/conductor/manager.py:91}} Apr 21 10:59:27.133348 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-b22fefa5-a7d6-4ca8-ba60-2c174065ce3c tempest-ServerShowV257Test-926576958 tempest-ServerShowV257Test-926576958-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:59:27.133814 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-b22fefa5-a7d6-4ca8-ba60-2c174065ce3c tempest-ServerShowV257Test-926576958 tempest-ServerShowV257Test-926576958-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:59:27.192746 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-b22fefa5-a7d6-4ca8-ba60-2c174065ce3c tempest-ServerShowV257Test-926576958 tempest-ServerShowV257Test-926576958-project] [instance: f03f679a-55ff-4ba8-8f2c-008c20bc2856] No migration record for the rebuild/evacuate request. {{(pid=94357) rebuild_instance /opt/stack/nova/nova/conductor/manager.py:1101}} Apr 21 10:59:35.990732 n-d-811414-3 nova-conductor[94358]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f60095b5-b68f-459e-af9a-3776dcd48c13] AMQP server on 10.222.0.13:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 21 10:59:37.002788 n-d-811414-3 nova-conductor[94358]: INFO oslo.messaging._drivers.impl_rabbit [-] [f60095b5-b68f-459e-af9a-3776dcd48c13] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 33942. Apr 21 10:59:38.307346 n-d-811414-3 nova-conductor[94358]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 21 10:59:55.373636 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-b030dd78-89b9-424c-8d44-3ca410ea1c3b tempest-ServerRescueTestJSON-52466693 tempest-ServerRescueTestJSON-52466693-project] Took 0.41 seconds to select destinations for 1 instance(s). {{(pid=94358) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 21 10:59:55.414673 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-b030dd78-89b9-424c-8d44-3ca410ea1c3b tempest-ServerRescueTestJSON-52466693 tempest-ServerRescueTestJSON-52466693-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:59:55.415094 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-b030dd78-89b9-424c-8d44-3ca410ea1c3b tempest-ServerRescueTestJSON-52466693 tempest-ServerRescueTestJSON-52466693-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:59:55.478813 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-b030dd78-89b9-424c-8d44-3ca410ea1c3b tempest-ServerRescueTestJSON-52466693 tempest-ServerRescueTestJSON-52466693-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:59:55.479609 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-b030dd78-89b9-424c-8d44-3ca410ea1c3b tempest-ServerRescueTestJSON-52466693 tempest-ServerRescueTestJSON-52466693-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:59:55.481186 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-b030dd78-89b9-424c-8d44-3ca410ea1c3b tempest-ServerRescueTestJSON-52466693 tempest-ServerRescueTestJSON-52466693-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:59:55.482189 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-b030dd78-89b9-424c-8d44-3ca410ea1c3b tempest-ServerRescueTestJSON-52466693 tempest-ServerRescueTestJSON-52466693-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:59:55.513175 n-d-811414-3 nova-conductor[94358]: DEBUG nova.quota [None req-b030dd78-89b9-424c-8d44-3ca410ea1c3b tempest-ServerRescueTestJSON-52466693 tempest-ServerRescueTestJSON-52466693-project] Getting quotas for project 876ee59c4e6c42a5ae837b43ba0b154a. Resources: {'instances', 'cores', 'ram'} {{(pid=94358) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 21 10:59:55.520554 n-d-811414-3 nova-conductor[94358]: DEBUG nova.quota [None req-b030dd78-89b9-424c-8d44-3ca410ea1c3b tempest-ServerRescueTestJSON-52466693 tempest-ServerRescueTestJSON-52466693-project] Getting quotas for user b27b3cd91cba4bf7b8b6d01c59deaa89 and project 876ee59c4e6c42a5ae837b43ba0b154a. Resources: {'instances', 'cores', 'ram'} {{(pid=94358) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 21 10:59:55.537320 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-b030dd78-89b9-424c-8d44-3ca410ea1c3b tempest-ServerRescueTestJSON-52466693 tempest-ServerRescueTestJSON-52466693-project] [instance: cd8b3eb3-83ca-4747-b933-43ac1b2893ca] Selected host: n-h2-811414-3; Selected node: n-h2-811414-3; Alternates: [('n-h1-811414-3', 'n-h1-811414-3')] {{(pid=94358) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 21 10:59:55.538316 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-b030dd78-89b9-424c-8d44-3ca410ea1c3b tempest-ServerRescueTestJSON-52466693 tempest-ServerRescueTestJSON-52466693-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:59:55.538684 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-b030dd78-89b9-424c-8d44-3ca410ea1c3b tempest-ServerRescueTestJSON-52466693 tempest-ServerRescueTestJSON-52466693-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:59:55.548594 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-b030dd78-89b9-424c-8d44-3ca410ea1c3b tempest-ServerRescueTestJSON-52466693 tempest-ServerRescueTestJSON-52466693-project] [instance: cd8b3eb3-83ca-4747-b933-43ac1b2893ca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f5cdc3d5-9524-4220-a7fc-ab5606975fdb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94358) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 21 10:59:55.551789 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-b030dd78-89b9-424c-8d44-3ca410ea1c3b tempest-ServerRescueTestJSON-52466693 tempest-ServerRescueTestJSON-52466693-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:59:55.552262 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-b030dd78-89b9-424c-8d44-3ca410ea1c3b tempest-ServerRescueTestJSON-52466693 tempest-ServerRescueTestJSON-52466693-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:59:55.615327 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-b030dd78-89b9-424c-8d44-3ca410ea1c3b tempest-ServerRescueTestJSON-52466693 tempest-ServerRescueTestJSON-52466693-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:59:55.615804 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-b030dd78-89b9-424c-8d44-3ca410ea1c3b tempest-ServerRescueTestJSON-52466693 tempest-ServerRescueTestJSON-52466693-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:59:59.159336 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-2763be1c-0b11-4fff-bc10-66551f667924 tempest-TaggedBootDevicesTest-1337396163 tempest-TaggedBootDevicesTest-1337396163-project] Took 0.33 seconds to select destinations for 1 instance(s). {{(pid=94357) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 21 10:59:59.215110 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-2763be1c-0b11-4fff-bc10-66551f667924 tempest-TaggedBootDevicesTest-1337396163 tempest-TaggedBootDevicesTest-1337396163-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:59:59.215110 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-2763be1c-0b11-4fff-bc10-66551f667924 tempest-TaggedBootDevicesTest-1337396163 tempest-TaggedBootDevicesTest-1337396163-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:59:59.298550 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-2763be1c-0b11-4fff-bc10-66551f667924 tempest-TaggedBootDevicesTest-1337396163 tempest-TaggedBootDevicesTest-1337396163-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:59:59.299141 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-2763be1c-0b11-4fff-bc10-66551f667924 tempest-TaggedBootDevicesTest-1337396163 tempest-TaggedBootDevicesTest-1337396163-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:59:59.300101 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-2763be1c-0b11-4fff-bc10-66551f667924 tempest-TaggedBootDevicesTest-1337396163 tempest-TaggedBootDevicesTest-1337396163-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:59:59.300699 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-2763be1c-0b11-4fff-bc10-66551f667924 tempest-TaggedBootDevicesTest-1337396163 tempest-TaggedBootDevicesTest-1337396163-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:59:59.318219 n-d-811414-3 nova-conductor[94357]: DEBUG nova.quota [None req-2763be1c-0b11-4fff-bc10-66551f667924 tempest-TaggedBootDevicesTest-1337396163 tempest-TaggedBootDevicesTest-1337396163-project] Getting quotas for project ac349b4f5fef45c696f8b1a6dd37b14b. Resources: {'instances', 'cores', 'ram'} {{(pid=94357) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 21 10:59:59.325639 n-d-811414-3 nova-conductor[94357]: DEBUG nova.quota [None req-2763be1c-0b11-4fff-bc10-66551f667924 tempest-TaggedBootDevicesTest-1337396163 tempest-TaggedBootDevicesTest-1337396163-project] Getting quotas for user b6aa33235e514b94a7dfb642d266abe3 and project ac349b4f5fef45c696f8b1a6dd37b14b. Resources: {'instances', 'cores', 'ram'} {{(pid=94357) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 21 10:59:59.338977 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-2763be1c-0b11-4fff-bc10-66551f667924 tempest-TaggedBootDevicesTest-1337396163 tempest-TaggedBootDevicesTest-1337396163-project] [instance: fce3b9fa-fd2a-4424-94c7-3314933b46e6] Selected host: n-h1-811414-3; Selected node: n-h1-811414-3; Alternates: [('n-h2-811414-3', 'n-h2-811414-3')] {{(pid=94357) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 21 10:59:59.340504 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-2763be1c-0b11-4fff-bc10-66551f667924 tempest-TaggedBootDevicesTest-1337396163 tempest-TaggedBootDevicesTest-1337396163-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:59:59.341093 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-2763be1c-0b11-4fff-bc10-66551f667924 tempest-TaggedBootDevicesTest-1337396163 tempest-TaggedBootDevicesTest-1337396163-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:59:59.363715 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-2763be1c-0b11-4fff-bc10-66551f667924 tempest-TaggedBootDevicesTest-1337396163 tempest-TaggedBootDevicesTest-1337396163-project] [instance: fce3b9fa-fd2a-4424-94c7-3314933b46e6] block_device_mapping [BlockDeviceMapping(attachment_id=08fe559c-3f28-428d-b194-3ce33b23a3d8,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='402966f6-c922-44e8-ba25-13ae067f4034',volume_size=1,volume_type=None), BlockDeviceMapping(attachment_id=9c89118c-b730-4ceb-971e-422a1dd4fc43,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='59c79a78-9fb4-4154-b38d-f0fe5c5360b6',volume_size=1,volume_type=None), BlockDeviceMapping(attachment_id=4b16c1bd-5d0e-477f-98c9-92504d6ca539,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e1121bf0-c152-470b-a888-bf8a52c56463',volume_size=1,volume_type=None)] {{(pid=94357) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 21 10:59:59.367964 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-2763be1c-0b11-4fff-bc10-66551f667924 tempest-TaggedBootDevicesTest-1337396163 tempest-TaggedBootDevicesTest-1337396163-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:59:59.369199 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-2763be1c-0b11-4fff-bc10-66551f667924 tempest-TaggedBootDevicesTest-1337396163 tempest-TaggedBootDevicesTest-1337396163-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:59:59.383331 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-2763be1c-0b11-4fff-bc10-66551f667924 tempest-TaggedBootDevicesTest-1337396163 tempest-TaggedBootDevicesTest-1337396163-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:59:59.384092 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-2763be1c-0b11-4fff-bc10-66551f667924 tempest-TaggedBootDevicesTest-1337396163 tempest-TaggedBootDevicesTest-1337396163-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:59:59.399404 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-2763be1c-0b11-4fff-bc10-66551f667924 tempest-TaggedBootDevicesTest-1337396163 tempest-TaggedBootDevicesTest-1337396163-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:59:59.400920 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-2763be1c-0b11-4fff-bc10-66551f667924 tempest-TaggedBootDevicesTest-1337396163 tempest-TaggedBootDevicesTest-1337396163-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 10:59:59.452704 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-2763be1c-0b11-4fff-bc10-66551f667924 tempest-TaggedBootDevicesTest-1337396163 tempest-TaggedBootDevicesTest-1337396163-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 10:59:59.453401 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-2763be1c-0b11-4fff-bc10-66551f667924 tempest-TaggedBootDevicesTest-1337396163 tempest-TaggedBootDevicesTest-1337396163-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:00:31.831118 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-a559a08f-7a6e-4725-9164-4b75622b9cbe tempest-AttachVolumeNegativeTest-1247364855 tempest-AttachVolumeNegativeTest-1247364855-project] Took 0.42 seconds to select destinations for 1 instance(s). {{(pid=94358) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 21 11:00:31.879888 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-a559a08f-7a6e-4725-9164-4b75622b9cbe tempest-AttachVolumeNegativeTest-1247364855 tempest-AttachVolumeNegativeTest-1247364855-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:00:31.881819 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-a559a08f-7a6e-4725-9164-4b75622b9cbe tempest-AttachVolumeNegativeTest-1247364855 tempest-AttachVolumeNegativeTest-1247364855-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:00:31.993222 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-a559a08f-7a6e-4725-9164-4b75622b9cbe tempest-AttachVolumeNegativeTest-1247364855 tempest-AttachVolumeNegativeTest-1247364855-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:00:31.993628 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-a559a08f-7a6e-4725-9164-4b75622b9cbe tempest-AttachVolumeNegativeTest-1247364855 tempest-AttachVolumeNegativeTest-1247364855-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:00:31.994730 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-a559a08f-7a6e-4725-9164-4b75622b9cbe tempest-AttachVolumeNegativeTest-1247364855 tempest-AttachVolumeNegativeTest-1247364855-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:00:31.995467 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-a559a08f-7a6e-4725-9164-4b75622b9cbe tempest-AttachVolumeNegativeTest-1247364855 tempest-AttachVolumeNegativeTest-1247364855-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:00:32.032806 n-d-811414-3 nova-conductor[94358]: DEBUG nova.quota [None req-a559a08f-7a6e-4725-9164-4b75622b9cbe tempest-AttachVolumeNegativeTest-1247364855 tempest-AttachVolumeNegativeTest-1247364855-project] Getting quotas for project 29866dcd75fe4fbc957f714c9613892d. Resources: {'instances', 'cores', 'ram'} {{(pid=94358) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 21 11:00:32.038107 n-d-811414-3 nova-conductor[94358]: DEBUG nova.quota [None req-a559a08f-7a6e-4725-9164-4b75622b9cbe tempest-AttachVolumeNegativeTest-1247364855 tempest-AttachVolumeNegativeTest-1247364855-project] Getting quotas for user f6e303f306c94485802ba8edc7a7ba54 and project 29866dcd75fe4fbc957f714c9613892d. Resources: {'instances', 'cores', 'ram'} {{(pid=94358) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 21 11:00:32.054202 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-a559a08f-7a6e-4725-9164-4b75622b9cbe tempest-AttachVolumeNegativeTest-1247364855 tempest-AttachVolumeNegativeTest-1247364855-project] [instance: 11086405-f1bf-461e-8f76-21686522ab01] Selected host: n-h1-811414-3; Selected node: n-h1-811414-3; Alternates: [('n-h2-811414-3', 'n-h2-811414-3')] {{(pid=94358) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 21 11:00:32.055398 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-a559a08f-7a6e-4725-9164-4b75622b9cbe tempest-AttachVolumeNegativeTest-1247364855 tempest-AttachVolumeNegativeTest-1247364855-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:00:32.055886 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-a559a08f-7a6e-4725-9164-4b75622b9cbe tempest-AttachVolumeNegativeTest-1247364855 tempest-AttachVolumeNegativeTest-1247364855-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:00:32.065548 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-a559a08f-7a6e-4725-9164-4b75622b9cbe tempest-AttachVolumeNegativeTest-1247364855 tempest-AttachVolumeNegativeTest-1247364855-project] [instance: 11086405-f1bf-461e-8f76-21686522ab01] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f5cdc3d5-9524-4220-a7fc-ab5606975fdb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94358) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 21 11:00:32.067127 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-a559a08f-7a6e-4725-9164-4b75622b9cbe tempest-AttachVolumeNegativeTest-1247364855 tempest-AttachVolumeNegativeTest-1247364855-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:00:32.067636 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-a559a08f-7a6e-4725-9164-4b75622b9cbe tempest-AttachVolumeNegativeTest-1247364855 tempest-AttachVolumeNegativeTest-1247364855-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:00:32.164948 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-a559a08f-7a6e-4725-9164-4b75622b9cbe tempest-AttachVolumeNegativeTest-1247364855 tempest-AttachVolumeNegativeTest-1247364855-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:00:32.166544 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-a559a08f-7a6e-4725-9164-4b75622b9cbe tempest-AttachVolumeNegativeTest-1247364855 tempest-AttachVolumeNegativeTest-1247364855-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:00:32.245272 n-d-811414-3 nova-conductor[94357]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6404cb3a-bdc9-481c-93a6-d63501b53d9b] AMQP server on 10.222.0.13:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Apr 21 11:00:33.254367 n-d-811414-3 nova-conductor[94357]: INFO oslo.messaging._drivers.impl_rabbit [-] [6404cb3a-bdc9-481c-93a6-d63501b53d9b] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 34576. Apr 21 11:01:42.843375 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-ece04fc3-b87f-42b1-a095-525b5c583e31 tempest-ServerShowV247Test-449431291 tempest-ServerShowV247Test-449431291-project] Took 0.49 seconds to select destinations for 1 instance(s). {{(pid=94357) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 21 11:01:42.925275 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-ece04fc3-b87f-42b1-a095-525b5c583e31 tempest-ServerShowV247Test-449431291 tempest-ServerShowV247Test-449431291-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:01:42.925906 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-ece04fc3-b87f-42b1-a095-525b5c583e31 tempest-ServerShowV247Test-449431291 tempest-ServerShowV247Test-449431291-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:01:43.100615 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-ece04fc3-b87f-42b1-a095-525b5c583e31 tempest-ServerShowV247Test-449431291 tempest-ServerShowV247Test-449431291-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:01:43.101021 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-ece04fc3-b87f-42b1-a095-525b5c583e31 tempest-ServerShowV247Test-449431291 tempest-ServerShowV247Test-449431291-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:01:43.106386 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-ece04fc3-b87f-42b1-a095-525b5c583e31 tempest-ServerShowV247Test-449431291 tempest-ServerShowV247Test-449431291-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:01:43.108364 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-ece04fc3-b87f-42b1-a095-525b5c583e31 tempest-ServerShowV247Test-449431291 tempest-ServerShowV247Test-449431291-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:01:43.181342 n-d-811414-3 nova-conductor[94357]: DEBUG nova.quota [None req-ece04fc3-b87f-42b1-a095-525b5c583e31 tempest-ServerShowV247Test-449431291 tempest-ServerShowV247Test-449431291-project] Getting quotas for project da1f0eabd31841b3b3fc72211e2d675c. Resources: {'instances', 'cores', 'ram'} {{(pid=94357) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 21 11:01:43.196993 n-d-811414-3 nova-conductor[94357]: DEBUG nova.quota [None req-ece04fc3-b87f-42b1-a095-525b5c583e31 tempest-ServerShowV247Test-449431291 tempest-ServerShowV247Test-449431291-project] Getting quotas for user 0889de147f0a4ecc83a6faf109231c7b and project da1f0eabd31841b3b3fc72211e2d675c. Resources: {'instances', 'cores', 'ram'} {{(pid=94357) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 21 11:01:43.240822 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-ece04fc3-b87f-42b1-a095-525b5c583e31 tempest-ServerShowV247Test-449431291 tempest-ServerShowV247Test-449431291-project] [instance: 951120f3-10b7-47d5-b198-089fbc57cbea] Selected host: n-h2-811414-3; Selected node: n-h2-811414-3; Alternates: [('n-h1-811414-3', 'n-h1-811414-3')] {{(pid=94357) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 21 11:01:43.245384 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-ece04fc3-b87f-42b1-a095-525b5c583e31 tempest-ServerShowV247Test-449431291 tempest-ServerShowV247Test-449431291-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:01:43.247513 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-ece04fc3-b87f-42b1-a095-525b5c583e31 tempest-ServerShowV247Test-449431291 tempest-ServerShowV247Test-449431291-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:01:43.265378 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-ece04fc3-b87f-42b1-a095-525b5c583e31 tempest-ServerShowV247Test-449431291 tempest-ServerShowV247Test-449431291-project] [instance: 951120f3-10b7-47d5-b198-089fbc57cbea] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f5cdc3d5-9524-4220-a7fc-ab5606975fdb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94357) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 21 11:01:43.269684 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-ece04fc3-b87f-42b1-a095-525b5c583e31 tempest-ServerShowV247Test-449431291 tempest-ServerShowV247Test-449431291-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:01:43.270125 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-ece04fc3-b87f-42b1-a095-525b5c583e31 tempest-ServerShowV247Test-449431291 tempest-ServerShowV247Test-449431291-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:01:43.331250 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-ece04fc3-b87f-42b1-a095-525b5c583e31 tempest-ServerShowV247Test-449431291 tempest-ServerShowV247Test-449431291-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:01:43.331799 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-ece04fc3-b87f-42b1-a095-525b5c583e31 tempest-ServerShowV247Test-449431291 tempest-ServerShowV247Test-449431291-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:01:44.087078 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-74ce6867-11d9-4549-a693-f8e5d17f9818 tempest-ServerShowV247Test-449431291 tempest-ServerShowV247Test-449431291-project] Took 0.77 seconds to select destinations for 1 instance(s). {{(pid=94358) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 21 11:01:44.148289 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-74ce6867-11d9-4549-a693-f8e5d17f9818 tempest-ServerShowV247Test-449431291 tempest-ServerShowV247Test-449431291-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:01:44.148289 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-74ce6867-11d9-4549-a693-f8e5d17f9818 tempest-ServerShowV247Test-449431291 tempest-ServerShowV247Test-449431291-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:01:44.303039 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-74ce6867-11d9-4549-a693-f8e5d17f9818 tempest-ServerShowV247Test-449431291 tempest-ServerShowV247Test-449431291-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:01:44.306263 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-74ce6867-11d9-4549-a693-f8e5d17f9818 tempest-ServerShowV247Test-449431291 tempest-ServerShowV247Test-449431291-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:01:44.307238 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-74ce6867-11d9-4549-a693-f8e5d17f9818 tempest-ServerShowV247Test-449431291 tempest-ServerShowV247Test-449431291-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:01:44.308836 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-74ce6867-11d9-4549-a693-f8e5d17f9818 tempest-ServerShowV247Test-449431291 tempest-ServerShowV247Test-449431291-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:01:44.385028 n-d-811414-3 nova-conductor[94358]: DEBUG nova.quota [None req-74ce6867-11d9-4549-a693-f8e5d17f9818 tempest-ServerShowV247Test-449431291 tempest-ServerShowV247Test-449431291-project] Getting quotas for project da1f0eabd31841b3b3fc72211e2d675c. Resources: {'instances', 'cores', 'ram'} {{(pid=94358) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 21 11:01:44.395954 n-d-811414-3 nova-conductor[94358]: DEBUG nova.quota [None req-74ce6867-11d9-4549-a693-f8e5d17f9818 tempest-ServerShowV247Test-449431291 tempest-ServerShowV247Test-449431291-project] Getting quotas for user 0889de147f0a4ecc83a6faf109231c7b and project da1f0eabd31841b3b3fc72211e2d675c. Resources: {'instances', 'cores', 'ram'} {{(pid=94358) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 21 11:01:44.427031 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-74ce6867-11d9-4549-a693-f8e5d17f9818 tempest-ServerShowV247Test-449431291 tempest-ServerShowV247Test-449431291-project] [instance: 1d3effe8-6810-493b-899d-0a2b2731e8d7] Selected host: n-h2-811414-3; Selected node: n-h2-811414-3; Alternates: [('n-h1-811414-3', 'n-h1-811414-3')] {{(pid=94358) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 21 11:01:44.430582 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-74ce6867-11d9-4549-a693-f8e5d17f9818 tempest-ServerShowV247Test-449431291 tempest-ServerShowV247Test-449431291-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:01:44.431035 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-74ce6867-11d9-4549-a693-f8e5d17f9818 tempest-ServerShowV247Test-449431291 tempest-ServerShowV247Test-449431291-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:01:44.454101 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-74ce6867-11d9-4549-a693-f8e5d17f9818 tempest-ServerShowV247Test-449431291 tempest-ServerShowV247Test-449431291-project] [instance: 1d3effe8-6810-493b-899d-0a2b2731e8d7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f5cdc3d5-9524-4220-a7fc-ab5606975fdb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94358) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 21 11:01:44.456951 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-74ce6867-11d9-4549-a693-f8e5d17f9818 tempest-ServerShowV247Test-449431291 tempest-ServerShowV247Test-449431291-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:01:44.457566 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-74ce6867-11d9-4549-a693-f8e5d17f9818 tempest-ServerShowV247Test-449431291 tempest-ServerShowV247Test-449431291-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:01:44.516723 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-74ce6867-11d9-4549-a693-f8e5d17f9818 tempest-ServerShowV247Test-449431291 tempest-ServerShowV247Test-449431291-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:01:44.517157 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-74ce6867-11d9-4549-a693-f8e5d17f9818 tempest-ServerShowV247Test-449431291 tempest-ServerShowV247Test-449431291-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:01:51.074876 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-ff701a8e-afea-487c-b079-751b5bded374 tempest-ServerShowV247Test-449431291 tempest-ServerShowV247Test-449431291-project] Targeting cell 6c99d8ec-fb48-48af-b02b-a629a7c2cb6b(cell1) for conductor method rebuild_instance {{(pid=94357) wrapper /opt/stack/nova/nova/conductor/manager.py:91}} Apr 21 11:01:51.076141 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-ff701a8e-afea-487c-b079-751b5bded374 tempest-ServerShowV247Test-449431291 tempest-ServerShowV247Test-449431291-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:01:51.076790 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-ff701a8e-afea-487c-b079-751b5bded374 tempest-ServerShowV247Test-449431291 tempest-ServerShowV247Test-449431291-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:01:51.109245 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-ff701a8e-afea-487c-b079-751b5bded374 tempest-ServerShowV247Test-449431291 tempest-ServerShowV247Test-449431291-project] [instance: 1d3effe8-6810-493b-899d-0a2b2731e8d7] No migration record for the rebuild/evacuate request. {{(pid=94357) rebuild_instance /opt/stack/nova/nova/conductor/manager.py:1101}} Apr 21 11:02:02.752800 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-977f9bb1-d0d2-4e2e-b537-057046a6b470 tempest-AttachVolumeNegativeTest-1247364855 tempest-AttachVolumeNegativeTest-1247364855-project] Took 0.62 seconds to select destinations for 1 instance(s). {{(pid=94358) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 21 11:02:02.810692 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-977f9bb1-d0d2-4e2e-b537-057046a6b470 tempest-AttachVolumeNegativeTest-1247364855 tempest-AttachVolumeNegativeTest-1247364855-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:02:02.811290 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-977f9bb1-d0d2-4e2e-b537-057046a6b470 tempest-AttachVolumeNegativeTest-1247364855 tempest-AttachVolumeNegativeTest-1247364855-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:02:02.886988 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-977f9bb1-d0d2-4e2e-b537-057046a6b470 tempest-AttachVolumeNegativeTest-1247364855 tempest-AttachVolumeNegativeTest-1247364855-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:02:02.887386 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-977f9bb1-d0d2-4e2e-b537-057046a6b470 tempest-AttachVolumeNegativeTest-1247364855 tempest-AttachVolumeNegativeTest-1247364855-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:02:02.889328 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-977f9bb1-d0d2-4e2e-b537-057046a6b470 tempest-AttachVolumeNegativeTest-1247364855 tempest-AttachVolumeNegativeTest-1247364855-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:02:02.889729 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-977f9bb1-d0d2-4e2e-b537-057046a6b470 tempest-AttachVolumeNegativeTest-1247364855 tempest-AttachVolumeNegativeTest-1247364855-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:02:02.931807 n-d-811414-3 nova-conductor[94358]: DEBUG nova.quota [None req-977f9bb1-d0d2-4e2e-b537-057046a6b470 tempest-AttachVolumeNegativeTest-1247364855 tempest-AttachVolumeNegativeTest-1247364855-project] Getting quotas for project 29866dcd75fe4fbc957f714c9613892d. Resources: {'instances', 'cores', 'ram'} {{(pid=94358) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 21 11:02:02.939417 n-d-811414-3 nova-conductor[94358]: DEBUG nova.quota [None req-977f9bb1-d0d2-4e2e-b537-057046a6b470 tempest-AttachVolumeNegativeTest-1247364855 tempest-AttachVolumeNegativeTest-1247364855-project] Getting quotas for user f6e303f306c94485802ba8edc7a7ba54 and project 29866dcd75fe4fbc957f714c9613892d. Resources: {'instances', 'cores', 'ram'} {{(pid=94358) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 21 11:02:02.963756 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-977f9bb1-d0d2-4e2e-b537-057046a6b470 tempest-AttachVolumeNegativeTest-1247364855 tempest-AttachVolumeNegativeTest-1247364855-project] [instance: ce54e935-022f-42e6-a763-b7d11bd639f5] Selected host: n-h1-811414-3; Selected node: n-h1-811414-3; Alternates: [('n-h2-811414-3', 'n-h2-811414-3')] {{(pid=94358) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 21 11:02:02.967425 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-977f9bb1-d0d2-4e2e-b537-057046a6b470 tempest-AttachVolumeNegativeTest-1247364855 tempest-AttachVolumeNegativeTest-1247364855-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:02:02.968316 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-977f9bb1-d0d2-4e2e-b537-057046a6b470 tempest-AttachVolumeNegativeTest-1247364855 tempest-AttachVolumeNegativeTest-1247364855-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:02:02.981655 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-977f9bb1-d0d2-4e2e-b537-057046a6b470 tempest-AttachVolumeNegativeTest-1247364855 tempest-AttachVolumeNegativeTest-1247364855-project] [instance: ce54e935-022f-42e6-a763-b7d11bd639f5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f5cdc3d5-9524-4220-a7fc-ab5606975fdb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94358) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 21 11:02:02.983052 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-977f9bb1-d0d2-4e2e-b537-057046a6b470 tempest-AttachVolumeNegativeTest-1247364855 tempest-AttachVolumeNegativeTest-1247364855-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:02:02.983619 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-977f9bb1-d0d2-4e2e-b537-057046a6b470 tempest-AttachVolumeNegativeTest-1247364855 tempest-AttachVolumeNegativeTest-1247364855-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:02:03.035203 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-977f9bb1-d0d2-4e2e-b537-057046a6b470 tempest-AttachVolumeNegativeTest-1247364855 tempest-AttachVolumeNegativeTest-1247364855-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:02:03.035785 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-977f9bb1-d0d2-4e2e-b537-057046a6b470 tempest-AttachVolumeNegativeTest-1247364855 tempest-AttachVolumeNegativeTest-1247364855-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:02:37.007754 n-d-811414-3 nova-conductor[94358]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f60095b5-b68f-459e-af9a-3776dcd48c13] AMQP server on 10.222.0.13:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Apr 21 11:02:38.025289 n-d-811414-3 nova-conductor[94358]: INFO oslo.messaging._drivers.impl_rabbit [-] [f60095b5-b68f-459e-af9a-3776dcd48c13] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 38310. Apr 21 11:02:46.040635 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-474c95fa-fbc1-4018-a4af-f742fd95c72a tempest-ServersTestJSON-385351187 tempest-ServersTestJSON-385351187-project] Took 0.80 seconds to select destinations for 1 instance(s). {{(pid=94357) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 21 11:02:46.106141 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-474c95fa-fbc1-4018-a4af-f742fd95c72a tempest-ServersTestJSON-385351187 tempest-ServersTestJSON-385351187-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:02:46.106141 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-474c95fa-fbc1-4018-a4af-f742fd95c72a tempest-ServersTestJSON-385351187 tempest-ServersTestJSON-385351187-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:02:46.287289 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-474c95fa-fbc1-4018-a4af-f742fd95c72a tempest-ServersTestJSON-385351187 tempest-ServersTestJSON-385351187-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:02:46.294720 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-474c95fa-fbc1-4018-a4af-f742fd95c72a tempest-ServersTestJSON-385351187 tempest-ServersTestJSON-385351187-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:02:46.297317 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-474c95fa-fbc1-4018-a4af-f742fd95c72a tempest-ServersTestJSON-385351187 tempest-ServersTestJSON-385351187-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:02:46.299098 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-474c95fa-fbc1-4018-a4af-f742fd95c72a tempest-ServersTestJSON-385351187 tempest-ServersTestJSON-385351187-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:02:46.393087 n-d-811414-3 nova-conductor[94357]: DEBUG nova.quota [None req-474c95fa-fbc1-4018-a4af-f742fd95c72a tempest-ServersTestJSON-385351187 tempest-ServersTestJSON-385351187-project] Getting quotas for project d5ec18d655f9483aa71280f570cc097d. Resources: {'instances', 'cores', 'ram'} {{(pid=94357) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 21 11:02:46.405376 n-d-811414-3 nova-conductor[94357]: DEBUG nova.quota [None req-474c95fa-fbc1-4018-a4af-f742fd95c72a tempest-ServersTestJSON-385351187 tempest-ServersTestJSON-385351187-project] Getting quotas for user e160a45965624a2880b18ea066f1365c and project d5ec18d655f9483aa71280f570cc097d. Resources: {'instances', 'cores', 'ram'} {{(pid=94357) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 21 11:02:46.460407 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-474c95fa-fbc1-4018-a4af-f742fd95c72a tempest-ServersTestJSON-385351187 tempest-ServersTestJSON-385351187-project] [instance: 2761a1a4-6a38-48c0-9fab-88a469dbbab4] Selected host: n-h2-811414-3; Selected node: n-h2-811414-3; Alternates: [('n-h1-811414-3', 'n-h1-811414-3')] {{(pid=94357) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 21 11:02:46.460407 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-474c95fa-fbc1-4018-a4af-f742fd95c72a tempest-ServersTestJSON-385351187 tempest-ServersTestJSON-385351187-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:02:46.460407 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-474c95fa-fbc1-4018-a4af-f742fd95c72a tempest-ServersTestJSON-385351187 tempest-ServersTestJSON-385351187-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:02:46.490376 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-474c95fa-fbc1-4018-a4af-f742fd95c72a tempest-ServersTestJSON-385351187 tempest-ServersTestJSON-385351187-project] [instance: 2761a1a4-6a38-48c0-9fab-88a469dbbab4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f5cdc3d5-9524-4220-a7fc-ab5606975fdb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94357) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 21 11:02:46.497805 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-474c95fa-fbc1-4018-a4af-f742fd95c72a tempest-ServersTestJSON-385351187 tempest-ServersTestJSON-385351187-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:02:46.497805 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-474c95fa-fbc1-4018-a4af-f742fd95c72a tempest-ServersTestJSON-385351187 tempest-ServersTestJSON-385351187-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:02:46.570116 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-474c95fa-fbc1-4018-a4af-f742fd95c72a tempest-ServersTestJSON-385351187 tempest-ServersTestJSON-385351187-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:02:46.570116 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-474c95fa-fbc1-4018-a4af-f742fd95c72a tempest-ServersTestJSON-385351187 tempest-ServersTestJSON-385351187-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:02:58.322351 n-d-811414-3 nova-conductor[94358]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 21 11:03:14.130725 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-168a724c-701c-4c6a-a530-4dcd73d6c6c9 tempest-VolumesNegativeTest-352766913 tempest-VolumesNegativeTest-352766913-project] Took 0.49 seconds to select destinations for 1 instance(s). {{(pid=94358) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 21 11:03:14.238909 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-168a724c-701c-4c6a-a530-4dcd73d6c6c9 tempest-VolumesNegativeTest-352766913 tempest-VolumesNegativeTest-352766913-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:03:14.239316 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-168a724c-701c-4c6a-a530-4dcd73d6c6c9 tempest-VolumesNegativeTest-352766913 tempest-VolumesNegativeTest-352766913-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:03:14.345507 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-168a724c-701c-4c6a-a530-4dcd73d6c6c9 tempest-VolumesNegativeTest-352766913 tempest-VolumesNegativeTest-352766913-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:03:14.345977 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-168a724c-701c-4c6a-a530-4dcd73d6c6c9 tempest-VolumesNegativeTest-352766913 tempest-VolumesNegativeTest-352766913-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:03:14.346713 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-168a724c-701c-4c6a-a530-4dcd73d6c6c9 tempest-VolumesNegativeTest-352766913 tempest-VolumesNegativeTest-352766913-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:03:14.347301 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-168a724c-701c-4c6a-a530-4dcd73d6c6c9 tempest-VolumesNegativeTest-352766913 tempest-VolumesNegativeTest-352766913-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:03:14.377660 n-d-811414-3 nova-conductor[94358]: DEBUG nova.quota [None req-168a724c-701c-4c6a-a530-4dcd73d6c6c9 tempest-VolumesNegativeTest-352766913 tempest-VolumesNegativeTest-352766913-project] Getting quotas for project 2287ddc0684441dc8a4411f19ba8d1be. Resources: {'instances', 'cores', 'ram'} {{(pid=94358) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 21 11:03:14.417633 n-d-811414-3 nova-conductor[94358]: DEBUG nova.quota [None req-168a724c-701c-4c6a-a530-4dcd73d6c6c9 tempest-VolumesNegativeTest-352766913 tempest-VolumesNegativeTest-352766913-project] Getting quotas for user e1ab0978f24240aeb4e5d7893e561f11 and project 2287ddc0684441dc8a4411f19ba8d1be. Resources: {'instances', 'cores', 'ram'} {{(pid=94358) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 21 11:03:14.448397 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-168a724c-701c-4c6a-a530-4dcd73d6c6c9 tempest-VolumesNegativeTest-352766913 tempest-VolumesNegativeTest-352766913-project] [instance: 4eab7220-155e-4505-b8ec-c03df6a0b185] Selected host: n-h1-811414-3; Selected node: n-h1-811414-3; Alternates: [('n-h2-811414-3', 'n-h2-811414-3')] {{(pid=94358) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 21 11:03:14.449454 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-168a724c-701c-4c6a-a530-4dcd73d6c6c9 tempest-VolumesNegativeTest-352766913 tempest-VolumesNegativeTest-352766913-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:03:14.449956 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-168a724c-701c-4c6a-a530-4dcd73d6c6c9 tempest-VolumesNegativeTest-352766913 tempest-VolumesNegativeTest-352766913-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:03:14.514271 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-168a724c-701c-4c6a-a530-4dcd73d6c6c9 tempest-VolumesNegativeTest-352766913 tempest-VolumesNegativeTest-352766913-project] [instance: 4eab7220-155e-4505-b8ec-c03df6a0b185] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f5cdc3d5-9524-4220-a7fc-ab5606975fdb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94358) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 21 11:03:14.514271 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-168a724c-701c-4c6a-a530-4dcd73d6c6c9 tempest-VolumesNegativeTest-352766913 tempest-VolumesNegativeTest-352766913-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:03:14.514271 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-168a724c-701c-4c6a-a530-4dcd73d6c6c9 tempest-VolumesNegativeTest-352766913 tempest-VolumesNegativeTest-352766913-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:03:14.649736 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-168a724c-701c-4c6a-a530-4dcd73d6c6c9 tempest-VolumesNegativeTest-352766913 tempest-VolumesNegativeTest-352766913-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:03:14.649736 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-168a724c-701c-4c6a-a530-4dcd73d6c6c9 tempest-VolumesNegativeTest-352766913 tempest-VolumesNegativeTest-352766913-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:03:18.405780 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-db02bbe6-4d72-4b11-8fbb-509c77083084 tempest-ServersTestJSON-385351187 tempest-ServersTestJSON-385351187-project] Took 0.49 seconds to select destinations for 1 instance(s). {{(pid=94357) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 21 11:03:18.427618 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-db02bbe6-4d72-4b11-8fbb-509c77083084 tempest-ServersTestJSON-385351187 tempest-ServersTestJSON-385351187-project] [instance: f016232f-a5d1-422d-8a08-5ba975c146f1] While scheduling instance, the build request was already deleted. {{(pid=94357) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1572}} Apr 21 11:03:18.694306 n-d-811414-3 nova-conductor[94357]: DEBUG nova.scheduler.client.report [None req-db02bbe6-4d72-4b11-8fbb-509c77083084 tempest-ServersTestJSON-385351187 tempest-ServersTestJSON-385351187-project] Cannot delete allocation for f016232f-a5d1-422d-8a08-5ba975c146f1 consumer in placement as consumer does not exist {{(pid=94357) delete_allocation_for_instance /opt/stack/nova/nova/scheduler/client/report.py:2100}} Apr 21 11:03:18.707416 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-db02bbe6-4d72-4b11-8fbb-509c77083084 tempest-ServersTestJSON-385351187 tempest-ServersTestJSON-385351187-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:03:18.707416 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-db02bbe6-4d72-4b11-8fbb-509c77083084 tempest-ServersTestJSON-385351187 tempest-ServersTestJSON-385351187-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:03:18.707416 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-db02bbe6-4d72-4b11-8fbb-509c77083084 tempest-ServersTestJSON-385351187 tempest-ServersTestJSON-385351187-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:03:18.707416 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-db02bbe6-4d72-4b11-8fbb-509c77083084 tempest-ServersTestJSON-385351187 tempest-ServersTestJSON-385351187-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:03:18.783293 n-d-811414-3 nova-conductor[94357]: DEBUG nova.quota [None req-db02bbe6-4d72-4b11-8fbb-509c77083084 tempest-ServersTestJSON-385351187 tempest-ServersTestJSON-385351187-project] Getting quotas for project d5ec18d655f9483aa71280f570cc097d. Resources: {'instances', 'cores', 'ram'} {{(pid=94357) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 21 11:03:18.816152 n-d-811414-3 nova-conductor[94357]: DEBUG nova.quota [None req-db02bbe6-4d72-4b11-8fbb-509c77083084 tempest-ServersTestJSON-385351187 tempest-ServersTestJSON-385351187-project] Getting quotas for user e160a45965624a2880b18ea066f1365c and project d5ec18d655f9483aa71280f570cc097d. Resources: {'instances', 'cores', 'ram'} {{(pid=94357) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 21 11:03:22.463019 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-e0c85492-d8e0-4f8c-8ac3-c0d847ba3a5f tempest-ServersTestJSON-385351187 tempest-ServersTestJSON-385351187-project] Took 0.57 seconds to select destinations for 1 instance(s). {{(pid=94358) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 21 11:03:22.530447 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-e0c85492-d8e0-4f8c-8ac3-c0d847ba3a5f tempest-ServersTestJSON-385351187 tempest-ServersTestJSON-385351187-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:03:22.531871 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-e0c85492-d8e0-4f8c-8ac3-c0d847ba3a5f tempest-ServersTestJSON-385351187 tempest-ServersTestJSON-385351187-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:03:22.662602 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-e0c85492-d8e0-4f8c-8ac3-c0d847ba3a5f tempest-ServersTestJSON-385351187 tempest-ServersTestJSON-385351187-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:03:22.663018 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-e0c85492-d8e0-4f8c-8ac3-c0d847ba3a5f tempest-ServersTestJSON-385351187 tempest-ServersTestJSON-385351187-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:03:22.663758 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-e0c85492-d8e0-4f8c-8ac3-c0d847ba3a5f tempest-ServersTestJSON-385351187 tempest-ServersTestJSON-385351187-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:03:22.664155 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-e0c85492-d8e0-4f8c-8ac3-c0d847ba3a5f tempest-ServersTestJSON-385351187 tempest-ServersTestJSON-385351187-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:03:22.720643 n-d-811414-3 nova-conductor[94358]: DEBUG nova.quota [None req-e0c85492-d8e0-4f8c-8ac3-c0d847ba3a5f tempest-ServersTestJSON-385351187 tempest-ServersTestJSON-385351187-project] Getting quotas for project d5ec18d655f9483aa71280f570cc097d. Resources: {'instances', 'cores', 'ram'} {{(pid=94358) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 21 11:03:22.747436 n-d-811414-3 nova-conductor[94358]: DEBUG nova.quota [None req-e0c85492-d8e0-4f8c-8ac3-c0d847ba3a5f tempest-ServersTestJSON-385351187 tempest-ServersTestJSON-385351187-project] Getting quotas for user e160a45965624a2880b18ea066f1365c and project d5ec18d655f9483aa71280f570cc097d. Resources: {'instances', 'cores', 'ram'} {{(pid=94358) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 21 11:03:22.809379 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-e0c85492-d8e0-4f8c-8ac3-c0d847ba3a5f tempest-ServersTestJSON-385351187 tempest-ServersTestJSON-385351187-project] [instance: 5f232932-5518-4dea-9649-da969b0c0862] Selected host: n-h2-811414-3; Selected node: n-h2-811414-3; Alternates: [('n-h1-811414-3', 'n-h1-811414-3')] {{(pid=94358) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 21 11:03:22.810304 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-e0c85492-d8e0-4f8c-8ac3-c0d847ba3a5f tempest-ServersTestJSON-385351187 tempest-ServersTestJSON-385351187-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:03:22.810706 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-e0c85492-d8e0-4f8c-8ac3-c0d847ba3a5f tempest-ServersTestJSON-385351187 tempest-ServersTestJSON-385351187-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:03:22.821283 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-e0c85492-d8e0-4f8c-8ac3-c0d847ba3a5f tempest-ServersTestJSON-385351187 tempest-ServersTestJSON-385351187-project] [instance: 5f232932-5518-4dea-9649-da969b0c0862] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f5cdc3d5-9524-4220-a7fc-ab5606975fdb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94358) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 21 11:03:22.823069 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-e0c85492-d8e0-4f8c-8ac3-c0d847ba3a5f tempest-ServersTestJSON-385351187 tempest-ServersTestJSON-385351187-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:03:22.823704 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-e0c85492-d8e0-4f8c-8ac3-c0d847ba3a5f tempest-ServersTestJSON-385351187 tempest-ServersTestJSON-385351187-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:03:22.887760 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-e0c85492-d8e0-4f8c-8ac3-c0d847ba3a5f tempest-ServersTestJSON-385351187 tempest-ServersTestJSON-385351187-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:03:22.888059 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-e0c85492-d8e0-4f8c-8ac3-c0d847ba3a5f tempest-ServersTestJSON-385351187 tempest-ServersTestJSON-385351187-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:03:33.257532 n-d-811414-3 nova-conductor[94357]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6404cb3a-bdc9-481c-93a6-d63501b53d9b] AMQP server on 10.222.0.13:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Apr 21 11:03:34.270152 n-d-811414-3 nova-conductor[94357]: INFO oslo.messaging._drivers.impl_rabbit [-] [6404cb3a-bdc9-481c-93a6-d63501b53d9b] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 40304. Apr 21 11:03:50.618459 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-f738bd61-07ce-42a8-8f6c-1406bc1a186b tempest-AttachVolumeNegativeTest-1247364855 tempest-AttachVolumeNegativeTest-1247364855-project] Took 0.49 seconds to select destinations for 1 instance(s). {{(pid=94357) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 21 11:03:50.701404 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-f738bd61-07ce-42a8-8f6c-1406bc1a186b tempest-AttachVolumeNegativeTest-1247364855 tempest-AttachVolumeNegativeTest-1247364855-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:03:50.703183 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-f738bd61-07ce-42a8-8f6c-1406bc1a186b tempest-AttachVolumeNegativeTest-1247364855 tempest-AttachVolumeNegativeTest-1247364855-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:03:50.812218 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-f738bd61-07ce-42a8-8f6c-1406bc1a186b tempest-AttachVolumeNegativeTest-1247364855 tempest-AttachVolumeNegativeTest-1247364855-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:03:50.816334 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-f738bd61-07ce-42a8-8f6c-1406bc1a186b tempest-AttachVolumeNegativeTest-1247364855 tempest-AttachVolumeNegativeTest-1247364855-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:03:50.817126 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-f738bd61-07ce-42a8-8f6c-1406bc1a186b tempest-AttachVolumeNegativeTest-1247364855 tempest-AttachVolumeNegativeTest-1247364855-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:03:50.817527 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-f738bd61-07ce-42a8-8f6c-1406bc1a186b tempest-AttachVolumeNegativeTest-1247364855 tempest-AttachVolumeNegativeTest-1247364855-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:03:50.855113 n-d-811414-3 nova-conductor[94357]: DEBUG nova.quota [None req-f738bd61-07ce-42a8-8f6c-1406bc1a186b tempest-AttachVolumeNegativeTest-1247364855 tempest-AttachVolumeNegativeTest-1247364855-project] Getting quotas for project 29866dcd75fe4fbc957f714c9613892d. Resources: {'instances', 'cores', 'ram'} {{(pid=94357) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 21 11:03:50.863418 n-d-811414-3 nova-conductor[94357]: DEBUG nova.quota [None req-f738bd61-07ce-42a8-8f6c-1406bc1a186b tempest-AttachVolumeNegativeTest-1247364855 tempest-AttachVolumeNegativeTest-1247364855-project] Getting quotas for user f6e303f306c94485802ba8edc7a7ba54 and project 29866dcd75fe4fbc957f714c9613892d. Resources: {'instances', 'cores', 'ram'} {{(pid=94357) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 21 11:03:50.894060 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-f738bd61-07ce-42a8-8f6c-1406bc1a186b tempest-AttachVolumeNegativeTest-1247364855 tempest-AttachVolumeNegativeTest-1247364855-project] [instance: 667f11e2-32cc-4f24-9ec4-100c1d3b571b] Selected host: n-h1-811414-3; Selected node: n-h1-811414-3; Alternates: [('n-h2-811414-3', 'n-h2-811414-3')] {{(pid=94357) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 21 11:03:50.895160 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-f738bd61-07ce-42a8-8f6c-1406bc1a186b tempest-AttachVolumeNegativeTest-1247364855 tempest-AttachVolumeNegativeTest-1247364855-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:03:50.895676 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-f738bd61-07ce-42a8-8f6c-1406bc1a186b tempest-AttachVolumeNegativeTest-1247364855 tempest-AttachVolumeNegativeTest-1247364855-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:03:50.915339 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-f738bd61-07ce-42a8-8f6c-1406bc1a186b tempest-AttachVolumeNegativeTest-1247364855 tempest-AttachVolumeNegativeTest-1247364855-project] [instance: 667f11e2-32cc-4f24-9ec4-100c1d3b571b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f5cdc3d5-9524-4220-a7fc-ab5606975fdb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94357) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 21 11:03:50.916634 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-f738bd61-07ce-42a8-8f6c-1406bc1a186b tempest-AttachVolumeNegativeTest-1247364855 tempest-AttachVolumeNegativeTest-1247364855-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:03:50.918428 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-f738bd61-07ce-42a8-8f6c-1406bc1a186b tempest-AttachVolumeNegativeTest-1247364855 tempest-AttachVolumeNegativeTest-1247364855-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:03:50.975949 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-f738bd61-07ce-42a8-8f6c-1406bc1a186b tempest-AttachVolumeNegativeTest-1247364855 tempest-AttachVolumeNegativeTest-1247364855-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:03:50.976545 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-f738bd61-07ce-42a8-8f6c-1406bc1a186b tempest-AttachVolumeNegativeTest-1247364855 tempest-AttachVolumeNegativeTest-1247364855-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:03:51.427765 n-d-811414-3 nova-conductor[94357]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 21 11:03:55.579677 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-dcbed7af-ccfd-4250-abcd-fa835ef11044 tempest-ServersTestJSON-385351187 tempest-ServersTestJSON-385351187-project] Took 0.46 seconds to select destinations for 1 instance(s). {{(pid=94358) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 21 11:03:55.649536 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-dcbed7af-ccfd-4250-abcd-fa835ef11044 tempest-ServersTestJSON-385351187 tempest-ServersTestJSON-385351187-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:03:55.650255 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-dcbed7af-ccfd-4250-abcd-fa835ef11044 tempest-ServersTestJSON-385351187 tempest-ServersTestJSON-385351187-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:03:55.756758 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-dcbed7af-ccfd-4250-abcd-fa835ef11044 tempest-ServersTestJSON-385351187 tempest-ServersTestJSON-385351187-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:03:55.757167 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-dcbed7af-ccfd-4250-abcd-fa835ef11044 tempest-ServersTestJSON-385351187 tempest-ServersTestJSON-385351187-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:03:55.757889 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-dcbed7af-ccfd-4250-abcd-fa835ef11044 tempest-ServersTestJSON-385351187 tempest-ServersTestJSON-385351187-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:03:55.760786 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-dcbed7af-ccfd-4250-abcd-fa835ef11044 tempest-ServersTestJSON-385351187 tempest-ServersTestJSON-385351187-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:03:55.852689 n-d-811414-3 nova-conductor[94358]: DEBUG nova.quota [None req-dcbed7af-ccfd-4250-abcd-fa835ef11044 tempest-ServersTestJSON-385351187 tempest-ServersTestJSON-385351187-project] Getting quotas for project d5ec18d655f9483aa71280f570cc097d. Resources: {'instances', 'cores', 'ram'} {{(pid=94358) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 21 11:03:55.865632 n-d-811414-3 nova-conductor[94358]: DEBUG nova.quota [None req-dcbed7af-ccfd-4250-abcd-fa835ef11044 tempest-ServersTestJSON-385351187 tempest-ServersTestJSON-385351187-project] Getting quotas for user e160a45965624a2880b18ea066f1365c and project d5ec18d655f9483aa71280f570cc097d. Resources: {'instances', 'cores', 'ram'} {{(pid=94358) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 21 11:03:55.904981 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-dcbed7af-ccfd-4250-abcd-fa835ef11044 tempest-ServersTestJSON-385351187 tempest-ServersTestJSON-385351187-project] [instance: 4d5a700a-0055-4005-87a0-6863b01bd2ec] Selected host: n-h2-811414-3; Selected node: n-h2-811414-3; Alternates: [('n-h1-811414-3', 'n-h1-811414-3')] {{(pid=94358) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 21 11:03:55.909053 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-dcbed7af-ccfd-4250-abcd-fa835ef11044 tempest-ServersTestJSON-385351187 tempest-ServersTestJSON-385351187-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:03:55.916038 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-dcbed7af-ccfd-4250-abcd-fa835ef11044 tempest-ServersTestJSON-385351187 tempest-ServersTestJSON-385351187-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:03:55.932185 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-dcbed7af-ccfd-4250-abcd-fa835ef11044 tempest-ServersTestJSON-385351187 tempest-ServersTestJSON-385351187-project] [instance: 4d5a700a-0055-4005-87a0-6863b01bd2ec] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f5cdc3d5-9524-4220-a7fc-ab5606975fdb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94358) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 21 11:03:55.933722 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-dcbed7af-ccfd-4250-abcd-fa835ef11044 tempest-ServersTestJSON-385351187 tempest-ServersTestJSON-385351187-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:03:55.936321 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-dcbed7af-ccfd-4250-abcd-fa835ef11044 tempest-ServersTestJSON-385351187 tempest-ServersTestJSON-385351187-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:03:56.030189 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-dcbed7af-ccfd-4250-abcd-fa835ef11044 tempest-ServersTestJSON-385351187 tempest-ServersTestJSON-385351187-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:03:56.030593 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-dcbed7af-ccfd-4250-abcd-fa835ef11044 tempest-ServersTestJSON-385351187 tempest-ServersTestJSON-385351187-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:04:36.946115 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-75b05456-88d2-4620-b620-8eab4e4009d0 tempest-ServersTestJSON-385351187 tempest-ServersTestJSON-385351187-project] Took 0.85 seconds to select destinations for 1 instance(s). {{(pid=94357) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 21 11:04:36.978368 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-75b05456-88d2-4620-b620-8eab4e4009d0 tempest-ServersTestJSON-385351187 tempest-ServersTestJSON-385351187-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:04:36.980720 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-75b05456-88d2-4620-b620-8eab4e4009d0 tempest-ServersTestJSON-385351187 tempest-ServersTestJSON-385351187-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:04:37.057834 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-75b05456-88d2-4620-b620-8eab4e4009d0 tempest-ServersTestJSON-385351187 tempest-ServersTestJSON-385351187-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:04:37.058585 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-75b05456-88d2-4620-b620-8eab4e4009d0 tempest-ServersTestJSON-385351187 tempest-ServersTestJSON-385351187-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:04:37.059813 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-75b05456-88d2-4620-b620-8eab4e4009d0 tempest-ServersTestJSON-385351187 tempest-ServersTestJSON-385351187-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:04:37.060514 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-75b05456-88d2-4620-b620-8eab4e4009d0 tempest-ServersTestJSON-385351187 tempest-ServersTestJSON-385351187-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:04:37.083526 n-d-811414-3 nova-conductor[94357]: DEBUG nova.quota [None req-75b05456-88d2-4620-b620-8eab4e4009d0 tempest-ServersTestJSON-385351187 tempest-ServersTestJSON-385351187-project] Getting quotas for project d5ec18d655f9483aa71280f570cc097d. Resources: {'instances', 'cores', 'ram'} {{(pid=94357) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 21 11:04:37.088413 n-d-811414-3 nova-conductor[94357]: DEBUG nova.quota [None req-75b05456-88d2-4620-b620-8eab4e4009d0 tempest-ServersTestJSON-385351187 tempest-ServersTestJSON-385351187-project] Getting quotas for user e160a45965624a2880b18ea066f1365c and project d5ec18d655f9483aa71280f570cc097d. Resources: {'instances', 'cores', 'ram'} {{(pid=94357) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 21 11:04:37.101255 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-75b05456-88d2-4620-b620-8eab4e4009d0 tempest-ServersTestJSON-385351187 tempest-ServersTestJSON-385351187-project] [instance: 60821f0c-5a6d-42c4-b1a4-dd6b44213992] Selected host: n-h2-811414-3; Selected node: n-h2-811414-3; Alternates: [('n-h1-811414-3', 'n-h1-811414-3')] {{(pid=94357) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 21 11:04:37.103437 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-75b05456-88d2-4620-b620-8eab4e4009d0 tempest-ServersTestJSON-385351187 tempest-ServersTestJSON-385351187-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:04:37.104353 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-75b05456-88d2-4620-b620-8eab4e4009d0 tempest-ServersTestJSON-385351187 tempest-ServersTestJSON-385351187-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:04:37.115803 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-75b05456-88d2-4620-b620-8eab4e4009d0 tempest-ServersTestJSON-385351187 tempest-ServersTestJSON-385351187-project] [instance: 60821f0c-5a6d-42c4-b1a4-dd6b44213992] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f5cdc3d5-9524-4220-a7fc-ab5606975fdb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94357) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 21 11:04:37.117185 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-75b05456-88d2-4620-b620-8eab4e4009d0 tempest-ServersTestJSON-385351187 tempest-ServersTestJSON-385351187-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:04:37.117590 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-75b05456-88d2-4620-b620-8eab4e4009d0 tempest-ServersTestJSON-385351187 tempest-ServersTestJSON-385351187-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:04:37.203846 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-75b05456-88d2-4620-b620-8eab4e4009d0 tempest-ServersTestJSON-385351187 tempest-ServersTestJSON-385351187-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:04:37.204333 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-75b05456-88d2-4620-b620-8eab4e4009d0 tempest-ServersTestJSON-385351187 tempest-ServersTestJSON-385351187-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:04:44.291056 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-3f9fdabb-8b83-452d-b64c-82da08a21f14 tempest-VolumesActionsTest-629768564 tempest-VolumesActionsTest-629768564-project] Took 0.46 seconds to select destinations for 1 instance(s). {{(pid=94358) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 21 11:04:44.374154 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-3f9fdabb-8b83-452d-b64c-82da08a21f14 tempest-VolumesActionsTest-629768564 tempest-VolumesActionsTest-629768564-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:04:44.374600 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-3f9fdabb-8b83-452d-b64c-82da08a21f14 tempest-VolumesActionsTest-629768564 tempest-VolumesActionsTest-629768564-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:04:44.498723 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-3f9fdabb-8b83-452d-b64c-82da08a21f14 tempest-VolumesActionsTest-629768564 tempest-VolumesActionsTest-629768564-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:04:44.499339 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-3f9fdabb-8b83-452d-b64c-82da08a21f14 tempest-VolumesActionsTest-629768564 tempest-VolumesActionsTest-629768564-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:04:44.500922 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-3f9fdabb-8b83-452d-b64c-82da08a21f14 tempest-VolumesActionsTest-629768564 tempest-VolumesActionsTest-629768564-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:04:44.501470 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-3f9fdabb-8b83-452d-b64c-82da08a21f14 tempest-VolumesActionsTest-629768564 tempest-VolumesActionsTest-629768564-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:04:44.550512 n-d-811414-3 nova-conductor[94358]: DEBUG nova.quota [None req-3f9fdabb-8b83-452d-b64c-82da08a21f14 tempest-VolumesActionsTest-629768564 tempest-VolumesActionsTest-629768564-project] Getting quotas for project 96b062b1730c4e50a590bbdb3e079600. Resources: {'instances', 'cores', 'ram'} {{(pid=94358) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 21 11:04:44.576738 n-d-811414-3 nova-conductor[94358]: DEBUG nova.quota [None req-3f9fdabb-8b83-452d-b64c-82da08a21f14 tempest-VolumesActionsTest-629768564 tempest-VolumesActionsTest-629768564-project] Getting quotas for user 935a30063f204ac99ea56bfa513bd42b and project 96b062b1730c4e50a590bbdb3e079600. Resources: {'instances', 'cores', 'ram'} {{(pid=94358) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 21 11:04:44.615683 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-3f9fdabb-8b83-452d-b64c-82da08a21f14 tempest-VolumesActionsTest-629768564 tempest-VolumesActionsTest-629768564-project] [instance: b5492642-362a-4279-9cdc-f64f6cd539cf] Selected host: n-h1-811414-3; Selected node: n-h1-811414-3; Alternates: [('n-h2-811414-3', 'n-h2-811414-3')] {{(pid=94358) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 21 11:04:44.621911 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-3f9fdabb-8b83-452d-b64c-82da08a21f14 tempest-VolumesActionsTest-629768564 tempest-VolumesActionsTest-629768564-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:04:44.628956 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-3f9fdabb-8b83-452d-b64c-82da08a21f14 tempest-VolumesActionsTest-629768564 tempest-VolumesActionsTest-629768564-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:04:44.650581 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-3f9fdabb-8b83-452d-b64c-82da08a21f14 tempest-VolumesActionsTest-629768564 tempest-VolumesActionsTest-629768564-project] [instance: b5492642-362a-4279-9cdc-f64f6cd539cf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f5cdc3d5-9524-4220-a7fc-ab5606975fdb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94358) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 21 11:04:44.652227 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-3f9fdabb-8b83-452d-b64c-82da08a21f14 tempest-VolumesActionsTest-629768564 tempest-VolumesActionsTest-629768564-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:04:44.652855 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-3f9fdabb-8b83-452d-b64c-82da08a21f14 tempest-VolumesActionsTest-629768564 tempest-VolumesActionsTest-629768564-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:04:44.712050 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-3f9fdabb-8b83-452d-b64c-82da08a21f14 tempest-VolumesActionsTest-629768564 tempest-VolumesActionsTest-629768564-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:04:44.712562 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-3f9fdabb-8b83-452d-b64c-82da08a21f14 tempest-VolumesActionsTest-629768564 tempest-VolumesActionsTest-629768564-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:04:47.844540 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-e9e553ff-f176-46bc-8e09-2fcacf42d40f tempest-TestServerBasicOps-971096706 tempest-TestServerBasicOps-971096706-project] Took 0.48 seconds to select destinations for 1 instance(s). {{(pid=94357) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 21 11:04:47.896418 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-e9e553ff-f176-46bc-8e09-2fcacf42d40f tempest-TestServerBasicOps-971096706 tempest-TestServerBasicOps-971096706-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:04:47.897297 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-e9e553ff-f176-46bc-8e09-2fcacf42d40f tempest-TestServerBasicOps-971096706 tempest-TestServerBasicOps-971096706-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:04:47.981624 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-e9e553ff-f176-46bc-8e09-2fcacf42d40f tempest-TestServerBasicOps-971096706 tempest-TestServerBasicOps-971096706-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:04:47.982381 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-e9e553ff-f176-46bc-8e09-2fcacf42d40f tempest-TestServerBasicOps-971096706 tempest-TestServerBasicOps-971096706-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:04:47.983375 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-e9e553ff-f176-46bc-8e09-2fcacf42d40f tempest-TestServerBasicOps-971096706 tempest-TestServerBasicOps-971096706-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:04:47.984077 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-e9e553ff-f176-46bc-8e09-2fcacf42d40f tempest-TestServerBasicOps-971096706 tempest-TestServerBasicOps-971096706-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:04:48.007452 n-d-811414-3 nova-conductor[94357]: DEBUG nova.quota [None req-e9e553ff-f176-46bc-8e09-2fcacf42d40f tempest-TestServerBasicOps-971096706 tempest-TestServerBasicOps-971096706-project] Getting quotas for project 296dabe0f44841c89f89427f31e410c1. Resources: {'instances', 'cores', 'ram'} {{(pid=94357) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 21 11:04:48.014204 n-d-811414-3 nova-conductor[94357]: DEBUG nova.quota [None req-e9e553ff-f176-46bc-8e09-2fcacf42d40f tempest-TestServerBasicOps-971096706 tempest-TestServerBasicOps-971096706-project] Getting quotas for user c04dcfe0adeb4a9eabfc1635d264f98a and project 296dabe0f44841c89f89427f31e410c1. Resources: {'instances', 'cores', 'ram'} {{(pid=94357) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 21 11:04:48.030709 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-e9e553ff-f176-46bc-8e09-2fcacf42d40f tempest-TestServerBasicOps-971096706 tempest-TestServerBasicOps-971096706-project] [instance: ea7b7fa5-ebe0-4cf0-ae6b-15ebf6d5e4eb] Selected host: n-h2-811414-3; Selected node: n-h2-811414-3; Alternates: [('n-h1-811414-3', 'n-h1-811414-3')] {{(pid=94357) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 21 11:04:48.032165 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-e9e553ff-f176-46bc-8e09-2fcacf42d40f tempest-TestServerBasicOps-971096706 tempest-TestServerBasicOps-971096706-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:04:48.032831 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-e9e553ff-f176-46bc-8e09-2fcacf42d40f tempest-TestServerBasicOps-971096706 tempest-TestServerBasicOps-971096706-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:04:48.056039 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-e9e553ff-f176-46bc-8e09-2fcacf42d40f tempest-TestServerBasicOps-971096706 tempest-TestServerBasicOps-971096706-project] [instance: ea7b7fa5-ebe0-4cf0-ae6b-15ebf6d5e4eb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f5cdc3d5-9524-4220-a7fc-ab5606975fdb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94357) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 21 11:04:48.057449 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-e9e553ff-f176-46bc-8e09-2fcacf42d40f tempest-TestServerBasicOps-971096706 tempest-TestServerBasicOps-971096706-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:04:48.063392 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-e9e553ff-f176-46bc-8e09-2fcacf42d40f tempest-TestServerBasicOps-971096706 tempest-TestServerBasicOps-971096706-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:04:48.154094 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-e9e553ff-f176-46bc-8e09-2fcacf42d40f tempest-TestServerBasicOps-971096706 tempest-TestServerBasicOps-971096706-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:04:48.154497 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-e9e553ff-f176-46bc-8e09-2fcacf42d40f tempest-TestServerBasicOps-971096706 tempest-TestServerBasicOps-971096706-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:05:01.663722 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-9e4faf3f-38bc-4dc3-8c93-c0bafaef94f4 tempest-ServersTestJSON-385351187 tempest-ServersTestJSON-385351187-project] Took 0.39 seconds to select destinations for 1 instance(s). {{(pid=94358) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 21 11:05:01.689697 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-9e4faf3f-38bc-4dc3-8c93-c0bafaef94f4 tempest-ServersTestJSON-385351187 tempest-ServersTestJSON-385351187-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:05:01.690713 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-9e4faf3f-38bc-4dc3-8c93-c0bafaef94f4 tempest-ServersTestJSON-385351187 tempest-ServersTestJSON-385351187-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:05:01.754046 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-9e4faf3f-38bc-4dc3-8c93-c0bafaef94f4 tempest-ServersTestJSON-385351187 tempest-ServersTestJSON-385351187-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:05:01.754699 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-9e4faf3f-38bc-4dc3-8c93-c0bafaef94f4 tempest-ServersTestJSON-385351187 tempest-ServersTestJSON-385351187-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:05:01.755590 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-9e4faf3f-38bc-4dc3-8c93-c0bafaef94f4 tempest-ServersTestJSON-385351187 tempest-ServersTestJSON-385351187-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:05:01.755979 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-9e4faf3f-38bc-4dc3-8c93-c0bafaef94f4 tempest-ServersTestJSON-385351187 tempest-ServersTestJSON-385351187-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:05:01.772626 n-d-811414-3 nova-conductor[94358]: DEBUG nova.quota [None req-9e4faf3f-38bc-4dc3-8c93-c0bafaef94f4 tempest-ServersTestJSON-385351187 tempest-ServersTestJSON-385351187-project] Getting quotas for project d5ec18d655f9483aa71280f570cc097d. Resources: {'instances', 'cores', 'ram'} {{(pid=94358) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 21 11:05:01.777149 n-d-811414-3 nova-conductor[94358]: DEBUG nova.quota [None req-9e4faf3f-38bc-4dc3-8c93-c0bafaef94f4 tempest-ServersTestJSON-385351187 tempest-ServersTestJSON-385351187-project] Getting quotas for user e160a45965624a2880b18ea066f1365c and project d5ec18d655f9483aa71280f570cc097d. Resources: {'instances', 'cores', 'ram'} {{(pid=94358) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 21 11:05:01.790959 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-9e4faf3f-38bc-4dc3-8c93-c0bafaef94f4 tempest-ServersTestJSON-385351187 tempest-ServersTestJSON-385351187-project] [instance: d334c216-3198-4665-826a-e7a1525a181a] Selected host: n-h1-811414-3; Selected node: n-h1-811414-3; Alternates: [('n-h2-811414-3', 'n-h2-811414-3')] {{(pid=94358) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 21 11:05:01.791902 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-9e4faf3f-38bc-4dc3-8c93-c0bafaef94f4 tempest-ServersTestJSON-385351187 tempest-ServersTestJSON-385351187-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:05:01.792459 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-9e4faf3f-38bc-4dc3-8c93-c0bafaef94f4 tempest-ServersTestJSON-385351187 tempest-ServersTestJSON-385351187-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:05:01.800300 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-9e4faf3f-38bc-4dc3-8c93-c0bafaef94f4 tempest-ServersTestJSON-385351187 tempest-ServersTestJSON-385351187-project] [instance: d334c216-3198-4665-826a-e7a1525a181a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f5cdc3d5-9524-4220-a7fc-ab5606975fdb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94358) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 21 11:05:01.801642 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-9e4faf3f-38bc-4dc3-8c93-c0bafaef94f4 tempest-ServersTestJSON-385351187 tempest-ServersTestJSON-385351187-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:05:01.802212 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-9e4faf3f-38bc-4dc3-8c93-c0bafaef94f4 tempest-ServersTestJSON-385351187 tempest-ServersTestJSON-385351187-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:05:01.833540 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-9e4faf3f-38bc-4dc3-8c93-c0bafaef94f4 tempest-ServersTestJSON-385351187 tempest-ServersTestJSON-385351187-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:05:01.833993 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-9e4faf3f-38bc-4dc3-8c93-c0bafaef94f4 tempest-ServersTestJSON-385351187 tempest-ServersTestJSON-385351187-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:05:37.879976 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-94489df2-5164-4f11-9049-e84c23c17a89 tempest-AttachVolumeNegativeTest-1247364855 tempest-AttachVolumeNegativeTest-1247364855-project] Took 0.62 seconds to select destinations for 1 instance(s). {{(pid=94357) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 21 11:05:37.939604 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-94489df2-5164-4f11-9049-e84c23c17a89 tempest-AttachVolumeNegativeTest-1247364855 tempest-AttachVolumeNegativeTest-1247364855-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:05:37.940324 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-94489df2-5164-4f11-9049-e84c23c17a89 tempest-AttachVolumeNegativeTest-1247364855 tempest-AttachVolumeNegativeTest-1247364855-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:05:38.016300 n-d-811414-3 nova-conductor[94358]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f60095b5-b68f-459e-af9a-3776dcd48c13] AMQP server on 10.222.0.13:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Apr 21 11:05:38.051388 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-94489df2-5164-4f11-9049-e84c23c17a89 tempest-AttachVolumeNegativeTest-1247364855 tempest-AttachVolumeNegativeTest-1247364855-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:05:38.052626 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-94489df2-5164-4f11-9049-e84c23c17a89 tempest-AttachVolumeNegativeTest-1247364855 tempest-AttachVolumeNegativeTest-1247364855-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:05:38.053885 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-94489df2-5164-4f11-9049-e84c23c17a89 tempest-AttachVolumeNegativeTest-1247364855 tempest-AttachVolumeNegativeTest-1247364855-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:05:38.054475 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-94489df2-5164-4f11-9049-e84c23c17a89 tempest-AttachVolumeNegativeTest-1247364855 tempest-AttachVolumeNegativeTest-1247364855-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:05:38.151628 n-d-811414-3 nova-conductor[94357]: DEBUG nova.quota [None req-94489df2-5164-4f11-9049-e84c23c17a89 tempest-AttachVolumeNegativeTest-1247364855 tempest-AttachVolumeNegativeTest-1247364855-project] Getting quotas for project 29866dcd75fe4fbc957f714c9613892d. Resources: {'instances', 'cores', 'ram'} {{(pid=94357) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 21 11:05:38.163613 n-d-811414-3 nova-conductor[94357]: DEBUG nova.quota [None req-94489df2-5164-4f11-9049-e84c23c17a89 tempest-AttachVolumeNegativeTest-1247364855 tempest-AttachVolumeNegativeTest-1247364855-project] Getting quotas for user f6e303f306c94485802ba8edc7a7ba54 and project 29866dcd75fe4fbc957f714c9613892d. Resources: {'instances', 'cores', 'ram'} {{(pid=94357) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 21 11:05:38.208148 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-94489df2-5164-4f11-9049-e84c23c17a89 tempest-AttachVolumeNegativeTest-1247364855 tempest-AttachVolumeNegativeTest-1247364855-project] [instance: 60f62deb-990a-4e61-8b33-5de82a496820] Selected host: n-h1-811414-3; Selected node: n-h1-811414-3; Alternates: [('n-h2-811414-3', 'n-h2-811414-3')] {{(pid=94357) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 21 11:05:38.213485 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-94489df2-5164-4f11-9049-e84c23c17a89 tempest-AttachVolumeNegativeTest-1247364855 tempest-AttachVolumeNegativeTest-1247364855-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:05:38.213485 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-94489df2-5164-4f11-9049-e84c23c17a89 tempest-AttachVolumeNegativeTest-1247364855 tempest-AttachVolumeNegativeTest-1247364855-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:05:38.237405 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-94489df2-5164-4f11-9049-e84c23c17a89 tempest-AttachVolumeNegativeTest-1247364855 tempest-AttachVolumeNegativeTest-1247364855-project] [instance: 60f62deb-990a-4e61-8b33-5de82a496820] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f5cdc3d5-9524-4220-a7fc-ab5606975fdb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94357) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 21 11:05:38.244734 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-94489df2-5164-4f11-9049-e84c23c17a89 tempest-AttachVolumeNegativeTest-1247364855 tempest-AttachVolumeNegativeTest-1247364855-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:05:38.246387 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-94489df2-5164-4f11-9049-e84c23c17a89 tempest-AttachVolumeNegativeTest-1247364855 tempest-AttachVolumeNegativeTest-1247364855-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:05:38.329942 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-94489df2-5164-4f11-9049-e84c23c17a89 tempest-AttachVolumeNegativeTest-1247364855 tempest-AttachVolumeNegativeTest-1247364855-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:05:38.331512 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-94489df2-5164-4f11-9049-e84c23c17a89 tempest-AttachVolumeNegativeTest-1247364855 tempest-AttachVolumeNegativeTest-1247364855-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:05:39.036845 n-d-811414-3 nova-conductor[94358]: INFO oslo.messaging._drivers.impl_rabbit [-] [f60095b5-b68f-459e-af9a-3776dcd48c13] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 44384. Apr 21 11:05:41.511952 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-113f7235-6ff9-4c01-b4fa-9bb43e223f31 tempest-ServersTestJSON-385351187 tempest-ServersTestJSON-385351187-project] Took 0.31 seconds to select destinations for 1 instance(s). {{(pid=94358) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 21 11:05:41.558335 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-113f7235-6ff9-4c01-b4fa-9bb43e223f31 tempest-ServersTestJSON-385351187 tempest-ServersTestJSON-385351187-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:05:41.558577 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-113f7235-6ff9-4c01-b4fa-9bb43e223f31 tempest-ServersTestJSON-385351187 tempest-ServersTestJSON-385351187-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:05:41.635292 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-113f7235-6ff9-4c01-b4fa-9bb43e223f31 tempest-ServersTestJSON-385351187 tempest-ServersTestJSON-385351187-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:05:41.635694 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-113f7235-6ff9-4c01-b4fa-9bb43e223f31 tempest-ServersTestJSON-385351187 tempest-ServersTestJSON-385351187-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:05:41.636501 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-113f7235-6ff9-4c01-b4fa-9bb43e223f31 tempest-ServersTestJSON-385351187 tempest-ServersTestJSON-385351187-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:05:41.636905 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-113f7235-6ff9-4c01-b4fa-9bb43e223f31 tempest-ServersTestJSON-385351187 tempest-ServersTestJSON-385351187-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:05:41.729276 n-d-811414-3 nova-conductor[94358]: DEBUG nova.quota [None req-113f7235-6ff9-4c01-b4fa-9bb43e223f31 tempest-ServersTestJSON-385351187 tempest-ServersTestJSON-385351187-project] Getting quotas for project d5ec18d655f9483aa71280f570cc097d. Resources: {'instances', 'cores', 'ram'} {{(pid=94358) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 21 11:05:41.735374 n-d-811414-3 nova-conductor[94358]: DEBUG nova.quota [None req-113f7235-6ff9-4c01-b4fa-9bb43e223f31 tempest-ServersTestJSON-385351187 tempest-ServersTestJSON-385351187-project] Getting quotas for user e160a45965624a2880b18ea066f1365c and project d5ec18d655f9483aa71280f570cc097d. Resources: {'instances', 'cores', 'ram'} {{(pid=94358) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 21 11:05:41.781866 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-113f7235-6ff9-4c01-b4fa-9bb43e223f31 tempest-ServersTestJSON-385351187 tempest-ServersTestJSON-385351187-project] [instance: a5aa1fd7-f730-431b-901b-be2a70930599] Selected host: n-h1-811414-3; Selected node: n-h1-811414-3; Alternates: [('n-h2-811414-3', 'n-h2-811414-3')] {{(pid=94358) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 21 11:05:41.782837 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-113f7235-6ff9-4c01-b4fa-9bb43e223f31 tempest-ServersTestJSON-385351187 tempest-ServersTestJSON-385351187-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:05:41.783243 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-113f7235-6ff9-4c01-b4fa-9bb43e223f31 tempest-ServersTestJSON-385351187 tempest-ServersTestJSON-385351187-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:05:41.799633 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-113f7235-6ff9-4c01-b4fa-9bb43e223f31 tempest-ServersTestJSON-385351187 tempest-ServersTestJSON-385351187-project] [instance: a5aa1fd7-f730-431b-901b-be2a70930599] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f5cdc3d5-9524-4220-a7fc-ab5606975fdb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94358) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 21 11:05:41.801215 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-113f7235-6ff9-4c01-b4fa-9bb43e223f31 tempest-ServersTestJSON-385351187 tempest-ServersTestJSON-385351187-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:05:41.801659 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-113f7235-6ff9-4c01-b4fa-9bb43e223f31 tempest-ServersTestJSON-385351187 tempest-ServersTestJSON-385351187-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:05:41.935926 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-113f7235-6ff9-4c01-b4fa-9bb43e223f31 tempest-ServersTestJSON-385351187 tempest-ServersTestJSON-385351187-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:05:41.936289 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-113f7235-6ff9-4c01-b4fa-9bb43e223f31 tempest-ServersTestJSON-385351187 tempest-ServersTestJSON-385351187-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:06:18.331114 n-d-811414-3 nova-conductor[94358]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 21 11:06:21.334417 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-26376023-ec68-4d8e-8f57-269b3bf77dc5 tempest-ServersTestJSON-385351187 tempest-ServersTestJSON-385351187-project] Took 0.48 seconds to select destinations for 1 instance(s). {{(pid=94357) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 21 11:06:21.408605 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-26376023-ec68-4d8e-8f57-269b3bf77dc5 tempest-ServersTestJSON-385351187 tempest-ServersTestJSON-385351187-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:06:21.409171 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-26376023-ec68-4d8e-8f57-269b3bf77dc5 tempest-ServersTestJSON-385351187 tempest-ServersTestJSON-385351187-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:06:21.501832 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-26376023-ec68-4d8e-8f57-269b3bf77dc5 tempest-ServersTestJSON-385351187 tempest-ServersTestJSON-385351187-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:06:21.502290 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-26376023-ec68-4d8e-8f57-269b3bf77dc5 tempest-ServersTestJSON-385351187 tempest-ServersTestJSON-385351187-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:06:21.503125 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-26376023-ec68-4d8e-8f57-269b3bf77dc5 tempest-ServersTestJSON-385351187 tempest-ServersTestJSON-385351187-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:06:21.503642 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-26376023-ec68-4d8e-8f57-269b3bf77dc5 tempest-ServersTestJSON-385351187 tempest-ServersTestJSON-385351187-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:06:21.527755 n-d-811414-3 nova-conductor[94357]: DEBUG nova.quota [None req-26376023-ec68-4d8e-8f57-269b3bf77dc5 tempest-ServersTestJSON-385351187 tempest-ServersTestJSON-385351187-project] Getting quotas for project d5ec18d655f9483aa71280f570cc097d. Resources: {'instances', 'cores', 'ram'} {{(pid=94357) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 21 11:06:21.534996 n-d-811414-3 nova-conductor[94357]: DEBUG nova.quota [None req-26376023-ec68-4d8e-8f57-269b3bf77dc5 tempest-ServersTestJSON-385351187 tempest-ServersTestJSON-385351187-project] Getting quotas for user e160a45965624a2880b18ea066f1365c and project d5ec18d655f9483aa71280f570cc097d. Resources: {'instances', 'cores', 'ram'} {{(pid=94357) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 21 11:06:21.550980 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-26376023-ec68-4d8e-8f57-269b3bf77dc5 tempest-ServersTestJSON-385351187 tempest-ServersTestJSON-385351187-project] [instance: 8aad04ae-8a5b-4b6d-8283-e03f0e3e0954] Selected host: n-h1-811414-3; Selected node: n-h1-811414-3; Alternates: [('n-h2-811414-3', 'n-h2-811414-3')] {{(pid=94357) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 21 11:06:21.552948 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-26376023-ec68-4d8e-8f57-269b3bf77dc5 tempest-ServersTestJSON-385351187 tempest-ServersTestJSON-385351187-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:06:21.553547 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-26376023-ec68-4d8e-8f57-269b3bf77dc5 tempest-ServersTestJSON-385351187 tempest-ServersTestJSON-385351187-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:06:21.574678 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-26376023-ec68-4d8e-8f57-269b3bf77dc5 tempest-ServersTestJSON-385351187 tempest-ServersTestJSON-385351187-project] [instance: 8aad04ae-8a5b-4b6d-8283-e03f0e3e0954] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f5cdc3d5-9524-4220-a7fc-ab5606975fdb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94357) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 21 11:06:21.576565 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-26376023-ec68-4d8e-8f57-269b3bf77dc5 tempest-ServersTestJSON-385351187 tempest-ServersTestJSON-385351187-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:06:21.578894 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-26376023-ec68-4d8e-8f57-269b3bf77dc5 tempest-ServersTestJSON-385351187 tempest-ServersTestJSON-385351187-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:06:21.667024 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-26376023-ec68-4d8e-8f57-269b3bf77dc5 tempest-ServersTestJSON-385351187 tempest-ServersTestJSON-385351187-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:06:21.667024 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-26376023-ec68-4d8e-8f57-269b3bf77dc5 tempest-ServersTestJSON-385351187 tempest-ServersTestJSON-385351187-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:06:34.271560 n-d-811414-3 nova-conductor[94357]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6404cb3a-bdc9-481c-93a6-d63501b53d9b] AMQP server on 10.222.0.13:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 21 11:06:35.281914 n-d-811414-3 nova-conductor[94357]: INFO oslo.messaging._drivers.impl_rabbit [-] [6404cb3a-bdc9-481c-93a6-d63501b53d9b] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 46436. Apr 21 11:07:04.534263 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-e28f030c-4a86-4f74-a874-dddb4bd6ff75 tempest-VolumesActionsTest-2051672120 tempest-VolumesActionsTest-2051672120-project] Took 0.49 seconds to select destinations for 1 instance(s). {{(pid=94358) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 21 11:07:04.568651 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-e28f030c-4a86-4f74-a874-dddb4bd6ff75 tempest-VolumesActionsTest-2051672120 tempest-VolumesActionsTest-2051672120-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:07:04.569356 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-e28f030c-4a86-4f74-a874-dddb4bd6ff75 tempest-VolumesActionsTest-2051672120 tempest-VolumesActionsTest-2051672120-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:07:04.680871 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-e28f030c-4a86-4f74-a874-dddb4bd6ff75 tempest-VolumesActionsTest-2051672120 tempest-VolumesActionsTest-2051672120-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:07:04.681682 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-e28f030c-4a86-4f74-a874-dddb4bd6ff75 tempest-VolumesActionsTest-2051672120 tempest-VolumesActionsTest-2051672120-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:07:04.684402 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-e28f030c-4a86-4f74-a874-dddb4bd6ff75 tempest-VolumesActionsTest-2051672120 tempest-VolumesActionsTest-2051672120-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:07:04.686782 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-e28f030c-4a86-4f74-a874-dddb4bd6ff75 tempest-VolumesActionsTest-2051672120 tempest-VolumesActionsTest-2051672120-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:07:04.736427 n-d-811414-3 nova-conductor[94358]: DEBUG nova.quota [None req-e28f030c-4a86-4f74-a874-dddb4bd6ff75 tempest-VolumesActionsTest-2051672120 tempest-VolumesActionsTest-2051672120-project] Getting quotas for project 961332e4a155435bb3b6459fa3d17d5b. Resources: {'instances', 'cores', 'ram'} {{(pid=94358) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 21 11:07:04.742888 n-d-811414-3 nova-conductor[94358]: DEBUG nova.quota [None req-e28f030c-4a86-4f74-a874-dddb4bd6ff75 tempest-VolumesActionsTest-2051672120 tempest-VolumesActionsTest-2051672120-project] Getting quotas for user 31a4703157004c99897e1f8b6d7122c2 and project 961332e4a155435bb3b6459fa3d17d5b. Resources: {'instances', 'cores', 'ram'} {{(pid=94358) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 21 11:07:04.760455 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-e28f030c-4a86-4f74-a874-dddb4bd6ff75 tempest-VolumesActionsTest-2051672120 tempest-VolumesActionsTest-2051672120-project] [instance: 4b404011-8bd0-4ad3-8516-5d3727a4ed17] Selected host: n-h2-811414-3; Selected node: n-h2-811414-3; Alternates: [('n-h1-811414-3', 'n-h1-811414-3')] {{(pid=94358) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 21 11:07:04.763186 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-e28f030c-4a86-4f74-a874-dddb4bd6ff75 tempest-VolumesActionsTest-2051672120 tempest-VolumesActionsTest-2051672120-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:07:04.763812 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-e28f030c-4a86-4f74-a874-dddb4bd6ff75 tempest-VolumesActionsTest-2051672120 tempest-VolumesActionsTest-2051672120-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:07:04.777633 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-e28f030c-4a86-4f74-a874-dddb4bd6ff75 tempest-VolumesActionsTest-2051672120 tempest-VolumesActionsTest-2051672120-project] [instance: 4b404011-8bd0-4ad3-8516-5d3727a4ed17] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f5cdc3d5-9524-4220-a7fc-ab5606975fdb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94358) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 21 11:07:04.780847 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-e28f030c-4a86-4f74-a874-dddb4bd6ff75 tempest-VolumesActionsTest-2051672120 tempest-VolumesActionsTest-2051672120-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:07:04.782830 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-e28f030c-4a86-4f74-a874-dddb4bd6ff75 tempest-VolumesActionsTest-2051672120 tempest-VolumesActionsTest-2051672120-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:07:04.847748 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-e28f030c-4a86-4f74-a874-dddb4bd6ff75 tempest-VolumesActionsTest-2051672120 tempest-VolumesActionsTest-2051672120-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:07:04.848212 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-e28f030c-4a86-4f74-a874-dddb4bd6ff75 tempest-VolumesActionsTest-2051672120 tempest-VolumesActionsTest-2051672120-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:07:11.437950 n-d-811414-3 nova-conductor[94357]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 21 11:07:15.892995 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-f89d40c8-a73f-451c-9f58-f3c95e3eff47 tempest-ServerActionsTestJSON-39410595 tempest-ServerActionsTestJSON-39410595-project] Took 0.41 seconds to select destinations for 1 instance(s). {{(pid=94357) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 21 11:07:15.934860 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-f89d40c8-a73f-451c-9f58-f3c95e3eff47 tempest-ServerActionsTestJSON-39410595 tempest-ServerActionsTestJSON-39410595-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:07:15.935689 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-f89d40c8-a73f-451c-9f58-f3c95e3eff47 tempest-ServerActionsTestJSON-39410595 tempest-ServerActionsTestJSON-39410595-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:07:16.043316 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-f89d40c8-a73f-451c-9f58-f3c95e3eff47 tempest-ServerActionsTestJSON-39410595 tempest-ServerActionsTestJSON-39410595-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:07:16.048259 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-f89d40c8-a73f-451c-9f58-f3c95e3eff47 tempest-ServerActionsTestJSON-39410595 tempest-ServerActionsTestJSON-39410595-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:07:16.049782 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-f89d40c8-a73f-451c-9f58-f3c95e3eff47 tempest-ServerActionsTestJSON-39410595 tempest-ServerActionsTestJSON-39410595-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:07:16.050338 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-f89d40c8-a73f-451c-9f58-f3c95e3eff47 tempest-ServerActionsTestJSON-39410595 tempest-ServerActionsTestJSON-39410595-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:07:16.095101 n-d-811414-3 nova-conductor[94357]: DEBUG nova.quota [None req-f89d40c8-a73f-451c-9f58-f3c95e3eff47 tempest-ServerActionsTestJSON-39410595 tempest-ServerActionsTestJSON-39410595-project] Getting quotas for project 439cca9b7ac448f1bd53517ca1184188. Resources: {'instances', 'cores', 'ram'} {{(pid=94357) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 21 11:07:16.107111 n-d-811414-3 nova-conductor[94357]: DEBUG nova.quota [None req-f89d40c8-a73f-451c-9f58-f3c95e3eff47 tempest-ServerActionsTestJSON-39410595 tempest-ServerActionsTestJSON-39410595-project] Getting quotas for user 677099018e3f4381a0eb5c606e46b6ec and project 439cca9b7ac448f1bd53517ca1184188. Resources: {'instances', 'cores', 'ram'} {{(pid=94357) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 21 11:07:16.140397 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-f89d40c8-a73f-451c-9f58-f3c95e3eff47 tempest-ServerActionsTestJSON-39410595 tempest-ServerActionsTestJSON-39410595-project] [instance: cbe0f503-e9e7-4995-aa72-5bddac52a74a] Selected host: n-h1-811414-3; Selected node: n-h1-811414-3; Alternates: [('n-h2-811414-3', 'n-h2-811414-3')] {{(pid=94357) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 21 11:07:16.144193 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-f89d40c8-a73f-451c-9f58-f3c95e3eff47 tempest-ServerActionsTestJSON-39410595 tempest-ServerActionsTestJSON-39410595-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:07:16.145869 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-f89d40c8-a73f-451c-9f58-f3c95e3eff47 tempest-ServerActionsTestJSON-39410595 tempest-ServerActionsTestJSON-39410595-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:07:16.156130 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-f89d40c8-a73f-451c-9f58-f3c95e3eff47 tempest-ServerActionsTestJSON-39410595 tempest-ServerActionsTestJSON-39410595-project] [instance: cbe0f503-e9e7-4995-aa72-5bddac52a74a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f5cdc3d5-9524-4220-a7fc-ab5606975fdb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94357) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 21 11:07:16.157787 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-f89d40c8-a73f-451c-9f58-f3c95e3eff47 tempest-ServerActionsTestJSON-39410595 tempest-ServerActionsTestJSON-39410595-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:07:16.158466 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-f89d40c8-a73f-451c-9f58-f3c95e3eff47 tempest-ServerActionsTestJSON-39410595 tempest-ServerActionsTestJSON-39410595-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:07:16.224412 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-f89d40c8-a73f-451c-9f58-f3c95e3eff47 tempest-ServerActionsTestJSON-39410595 tempest-ServerActionsTestJSON-39410595-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:07:16.224854 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-f89d40c8-a73f-451c-9f58-f3c95e3eff47 tempest-ServerActionsTestJSON-39410595 tempest-ServerActionsTestJSON-39410595-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:07:34.745141 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-29507745-414a-494a-afb1-bb6865dae105 tempest-VolumesActionsTest-2051672120 tempest-VolumesActionsTest-2051672120-project] Took 0.38 seconds to select destinations for 1 instance(s). {{(pid=94358) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 21 11:07:34.790895 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-29507745-414a-494a-afb1-bb6865dae105 tempest-VolumesActionsTest-2051672120 tempest-VolumesActionsTest-2051672120-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:07:34.791304 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-29507745-414a-494a-afb1-bb6865dae105 tempest-VolumesActionsTest-2051672120 tempest-VolumesActionsTest-2051672120-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:07:34.893028 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-29507745-414a-494a-afb1-bb6865dae105 tempest-VolumesActionsTest-2051672120 tempest-VolumesActionsTest-2051672120-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:07:34.895767 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-29507745-414a-494a-afb1-bb6865dae105 tempest-VolumesActionsTest-2051672120 tempest-VolumesActionsTest-2051672120-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:07:34.896748 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-29507745-414a-494a-afb1-bb6865dae105 tempest-VolumesActionsTest-2051672120 tempest-VolumesActionsTest-2051672120-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:07:34.902731 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-29507745-414a-494a-afb1-bb6865dae105 tempest-VolumesActionsTest-2051672120 tempest-VolumesActionsTest-2051672120-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:07:34.965464 n-d-811414-3 nova-conductor[94358]: DEBUG nova.quota [None req-29507745-414a-494a-afb1-bb6865dae105 tempest-VolumesActionsTest-2051672120 tempest-VolumesActionsTest-2051672120-project] Getting quotas for project 961332e4a155435bb3b6459fa3d17d5b. Resources: {'instances', 'cores', 'ram'} {{(pid=94358) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 21 11:07:34.980578 n-d-811414-3 nova-conductor[94358]: DEBUG nova.quota [None req-29507745-414a-494a-afb1-bb6865dae105 tempest-VolumesActionsTest-2051672120 tempest-VolumesActionsTest-2051672120-project] Getting quotas for user 31a4703157004c99897e1f8b6d7122c2 and project 961332e4a155435bb3b6459fa3d17d5b. Resources: {'instances', 'cores', 'ram'} {{(pid=94358) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 21 11:07:35.022461 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-29507745-414a-494a-afb1-bb6865dae105 tempest-VolumesActionsTest-2051672120 tempest-VolumesActionsTest-2051672120-project] [instance: 2a4180c7-06cf-4e8c-a48e-0c1e03886eda] Selected host: n-h2-811414-3; Selected node: n-h2-811414-3; Alternates: [('n-h1-811414-3', 'n-h1-811414-3')] {{(pid=94358) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 21 11:07:35.027684 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-29507745-414a-494a-afb1-bb6865dae105 tempest-VolumesActionsTest-2051672120 tempest-VolumesActionsTest-2051672120-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:07:35.031300 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-29507745-414a-494a-afb1-bb6865dae105 tempest-VolumesActionsTest-2051672120 tempest-VolumesActionsTest-2051672120-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:07:35.049750 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-29507745-414a-494a-afb1-bb6865dae105 tempest-VolumesActionsTest-2051672120 tempest-VolumesActionsTest-2051672120-project] [instance: 2a4180c7-06cf-4e8c-a48e-0c1e03886eda] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f5cdc3d5-9524-4220-a7fc-ab5606975fdb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94358) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 21 11:07:35.051218 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-29507745-414a-494a-afb1-bb6865dae105 tempest-VolumesActionsTest-2051672120 tempest-VolumesActionsTest-2051672120-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:07:35.051794 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-29507745-414a-494a-afb1-bb6865dae105 tempest-VolumesActionsTest-2051672120 tempest-VolumesActionsTest-2051672120-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:07:35.124654 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-29507745-414a-494a-afb1-bb6865dae105 tempest-VolumesActionsTest-2051672120 tempest-VolumesActionsTest-2051672120-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:07:35.125477 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-29507745-414a-494a-afb1-bb6865dae105 tempest-VolumesActionsTest-2051672120 tempest-VolumesActionsTest-2051672120-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:08:39.037881 n-d-811414-3 nova-conductor[94358]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f60095b5-b68f-459e-af9a-3776dcd48c13] AMQP server on 10.222.0.13:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 21 11:08:40.044981 n-d-811414-3 nova-conductor[94358]: INFO oslo.messaging._drivers.impl_rabbit [-] [f60095b5-b68f-459e-af9a-3776dcd48c13] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 49616. Apr 21 11:08:47.321888 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-64cf66c3-e998-4e4e-8114-bf2962ebb63a tempest-TestNetworkBasicOps-680659397 tempest-TestNetworkBasicOps-680659397-project] Took 0.54 seconds to select destinations for 1 instance(s). {{(pid=94357) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 21 11:08:47.371143 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-64cf66c3-e998-4e4e-8114-bf2962ebb63a tempest-TestNetworkBasicOps-680659397 tempest-TestNetworkBasicOps-680659397-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:08:47.376255 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-64cf66c3-e998-4e4e-8114-bf2962ebb63a tempest-TestNetworkBasicOps-680659397 tempest-TestNetworkBasicOps-680659397-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:08:47.483203 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-64cf66c3-e998-4e4e-8114-bf2962ebb63a tempest-TestNetworkBasicOps-680659397 tempest-TestNetworkBasicOps-680659397-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:08:47.483616 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-64cf66c3-e998-4e4e-8114-bf2962ebb63a tempest-TestNetworkBasicOps-680659397 tempest-TestNetworkBasicOps-680659397-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:08:47.484622 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-64cf66c3-e998-4e4e-8114-bf2962ebb63a tempest-TestNetworkBasicOps-680659397 tempest-TestNetworkBasicOps-680659397-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:08:47.485022 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-64cf66c3-e998-4e4e-8114-bf2962ebb63a tempest-TestNetworkBasicOps-680659397 tempest-TestNetworkBasicOps-680659397-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:08:47.509751 n-d-811414-3 nova-conductor[94357]: DEBUG nova.quota [None req-64cf66c3-e998-4e4e-8114-bf2962ebb63a tempest-TestNetworkBasicOps-680659397 tempest-TestNetworkBasicOps-680659397-project] Getting quotas for project 8bc20f1ee62f44ae95dbe2010ec7635f. Resources: {'instances', 'cores', 'ram'} {{(pid=94357) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 21 11:08:47.520275 n-d-811414-3 nova-conductor[94357]: DEBUG nova.quota [None req-64cf66c3-e998-4e4e-8114-bf2962ebb63a tempest-TestNetworkBasicOps-680659397 tempest-TestNetworkBasicOps-680659397-project] Getting quotas for user b94d5357b2dd4d3f9dbfc2cd7957ebd2 and project 8bc20f1ee62f44ae95dbe2010ec7635f. Resources: {'instances', 'cores', 'ram'} {{(pid=94357) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 21 11:08:47.532717 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-64cf66c3-e998-4e4e-8114-bf2962ebb63a tempest-TestNetworkBasicOps-680659397 tempest-TestNetworkBasicOps-680659397-project] [instance: 63bd3243-6846-4972-9067-25969af899ae] Selected host: n-h1-811414-3; Selected node: n-h1-811414-3; Alternates: [('n-h2-811414-3', 'n-h2-811414-3')] {{(pid=94357) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 21 11:08:47.533738 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-64cf66c3-e998-4e4e-8114-bf2962ebb63a tempest-TestNetworkBasicOps-680659397 tempest-TestNetworkBasicOps-680659397-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:08:47.534142 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-64cf66c3-e998-4e4e-8114-bf2962ebb63a tempest-TestNetworkBasicOps-680659397 tempest-TestNetworkBasicOps-680659397-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:08:47.542929 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-64cf66c3-e998-4e4e-8114-bf2962ebb63a tempest-TestNetworkBasicOps-680659397 tempest-TestNetworkBasicOps-680659397-project] [instance: 63bd3243-6846-4972-9067-25969af899ae] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f5cdc3d5-9524-4220-a7fc-ab5606975fdb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94357) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 21 11:08:47.544576 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-64cf66c3-e998-4e4e-8114-bf2962ebb63a tempest-TestNetworkBasicOps-680659397 tempest-TestNetworkBasicOps-680659397-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:08:47.545027 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-64cf66c3-e998-4e4e-8114-bf2962ebb63a tempest-TestNetworkBasicOps-680659397 tempest-TestNetworkBasicOps-680659397-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:08:47.592101 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-64cf66c3-e998-4e4e-8114-bf2962ebb63a tempest-TestNetworkBasicOps-680659397 tempest-TestNetworkBasicOps-680659397-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:08:47.592690 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-64cf66c3-e998-4e4e-8114-bf2962ebb63a tempest-TestNetworkBasicOps-680659397 tempest-TestNetworkBasicOps-680659397-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:09:27.873124 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-48d112f6-726a-459d-8771-e12f0c90e3a4 tempest-ServerActionsTestJSON-39410595 tempest-ServerActionsTestJSON-39410595-project] Took 0.29 seconds to select destinations for 1 instance(s). {{(pid=94358) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 21 11:09:27.910365 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-48d112f6-726a-459d-8771-e12f0c90e3a4 tempest-ServerActionsTestJSON-39410595 tempest-ServerActionsTestJSON-39410595-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:09:27.910996 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-48d112f6-726a-459d-8771-e12f0c90e3a4 tempest-ServerActionsTestJSON-39410595 tempest-ServerActionsTestJSON-39410595-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:09:27.976511 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-48d112f6-726a-459d-8771-e12f0c90e3a4 tempest-ServerActionsTestJSON-39410595 tempest-ServerActionsTestJSON-39410595-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:09:27.977118 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-48d112f6-726a-459d-8771-e12f0c90e3a4 tempest-ServerActionsTestJSON-39410595 tempest-ServerActionsTestJSON-39410595-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:09:27.977889 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-48d112f6-726a-459d-8771-e12f0c90e3a4 tempest-ServerActionsTestJSON-39410595 tempest-ServerActionsTestJSON-39410595-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:09:27.978284 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-48d112f6-726a-459d-8771-e12f0c90e3a4 tempest-ServerActionsTestJSON-39410595 tempest-ServerActionsTestJSON-39410595-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:09:27.996153 n-d-811414-3 nova-conductor[94358]: DEBUG nova.quota [None req-48d112f6-726a-459d-8771-e12f0c90e3a4 tempest-ServerActionsTestJSON-39410595 tempest-ServerActionsTestJSON-39410595-project] Getting quotas for project 439cca9b7ac448f1bd53517ca1184188. Resources: {'instances', 'cores', 'ram'} {{(pid=94358) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 21 11:09:28.001251 n-d-811414-3 nova-conductor[94358]: DEBUG nova.quota [None req-48d112f6-726a-459d-8771-e12f0c90e3a4 tempest-ServerActionsTestJSON-39410595 tempest-ServerActionsTestJSON-39410595-project] Getting quotas for user 677099018e3f4381a0eb5c606e46b6ec and project 439cca9b7ac448f1bd53517ca1184188. Resources: {'instances', 'cores', 'ram'} {{(pid=94358) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 21 11:09:28.027352 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-48d112f6-726a-459d-8771-e12f0c90e3a4 tempest-ServerActionsTestJSON-39410595 tempest-ServerActionsTestJSON-39410595-project] [instance: 10390d7f-0a95-4fcd-a000-0859e2ea8be1] Selected host: n-h2-811414-3; Selected node: n-h2-811414-3; Alternates: [('n-h1-811414-3', 'n-h1-811414-3')] {{(pid=94358) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 21 11:09:28.030070 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-48d112f6-726a-459d-8771-e12f0c90e3a4 tempest-ServerActionsTestJSON-39410595 tempest-ServerActionsTestJSON-39410595-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:09:28.030070 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-48d112f6-726a-459d-8771-e12f0c90e3a4 tempest-ServerActionsTestJSON-39410595 tempest-ServerActionsTestJSON-39410595-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:09:28.039938 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-48d112f6-726a-459d-8771-e12f0c90e3a4 tempest-ServerActionsTestJSON-39410595 tempest-ServerActionsTestJSON-39410595-project] [instance: 10390d7f-0a95-4fcd-a000-0859e2ea8be1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f5cdc3d5-9524-4220-a7fc-ab5606975fdb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94358) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 21 11:09:28.041602 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-48d112f6-726a-459d-8771-e12f0c90e3a4 tempest-ServerActionsTestJSON-39410595 tempest-ServerActionsTestJSON-39410595-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:09:28.042127 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-48d112f6-726a-459d-8771-e12f0c90e3a4 tempest-ServerActionsTestJSON-39410595 tempest-ServerActionsTestJSON-39410595-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:09:28.094576 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-48d112f6-726a-459d-8771-e12f0c90e3a4 tempest-ServerActionsTestJSON-39410595 tempest-ServerActionsTestJSON-39410595-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:09:28.095750 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-48d112f6-726a-459d-8771-e12f0c90e3a4 tempest-ServerActionsTestJSON-39410595 tempest-ServerActionsTestJSON-39410595-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:09:35.283259 n-d-811414-3 nova-conductor[94357]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6404cb3a-bdc9-481c-93a6-d63501b53d9b] AMQP server on 10.222.0.13:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Apr 21 11:09:36.293606 n-d-811414-3 nova-conductor[94357]: INFO oslo.messaging._drivers.impl_rabbit [-] [6404cb3a-bdc9-481c-93a6-d63501b53d9b] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 51828. Apr 21 11:09:38.341465 n-d-811414-3 nova-conductor[94358]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 21 11:09:57.909256 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-84ae8b88-d2db-4f23-8e66-291218ca02ad tempest-TestNetworkBasicOps-680659397 tempest-TestNetworkBasicOps-680659397-project] Took 1.03 seconds to select destinations for 1 instance(s). {{(pid=94357) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 21 11:09:57.957658 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-84ae8b88-d2db-4f23-8e66-291218ca02ad tempest-TestNetworkBasicOps-680659397 tempest-TestNetworkBasicOps-680659397-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:09:57.960338 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-84ae8b88-d2db-4f23-8e66-291218ca02ad tempest-TestNetworkBasicOps-680659397 tempest-TestNetworkBasicOps-680659397-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:09:58.045340 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-84ae8b88-d2db-4f23-8e66-291218ca02ad tempest-TestNetworkBasicOps-680659397 tempest-TestNetworkBasicOps-680659397-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:09:58.045928 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-84ae8b88-d2db-4f23-8e66-291218ca02ad tempest-TestNetworkBasicOps-680659397 tempest-TestNetworkBasicOps-680659397-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:09:58.046839 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-84ae8b88-d2db-4f23-8e66-291218ca02ad tempest-TestNetworkBasicOps-680659397 tempest-TestNetworkBasicOps-680659397-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:09:58.047667 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-84ae8b88-d2db-4f23-8e66-291218ca02ad tempest-TestNetworkBasicOps-680659397 tempest-TestNetworkBasicOps-680659397-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:09:58.068196 n-d-811414-3 nova-conductor[94357]: DEBUG nova.quota [None req-84ae8b88-d2db-4f23-8e66-291218ca02ad tempest-TestNetworkBasicOps-680659397 tempest-TestNetworkBasicOps-680659397-project] Getting quotas for project 8bc20f1ee62f44ae95dbe2010ec7635f. Resources: {'instances', 'cores', 'ram'} {{(pid=94357) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 21 11:09:58.073174 n-d-811414-3 nova-conductor[94357]: DEBUG nova.quota [None req-84ae8b88-d2db-4f23-8e66-291218ca02ad tempest-TestNetworkBasicOps-680659397 tempest-TestNetworkBasicOps-680659397-project] Getting quotas for user b94d5357b2dd4d3f9dbfc2cd7957ebd2 and project 8bc20f1ee62f44ae95dbe2010ec7635f. Resources: {'instances', 'cores', 'ram'} {{(pid=94357) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 21 11:09:58.085891 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-84ae8b88-d2db-4f23-8e66-291218ca02ad tempest-TestNetworkBasicOps-680659397 tempest-TestNetworkBasicOps-680659397-project] [instance: ba394f20-f42c-43e4-b571-4a023cedbe4e] Selected host: n-h1-811414-3; Selected node: n-h1-811414-3; Alternates: [('n-h2-811414-3', 'n-h2-811414-3')] {{(pid=94357) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 21 11:09:58.087372 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-84ae8b88-d2db-4f23-8e66-291218ca02ad tempest-TestNetworkBasicOps-680659397 tempest-TestNetworkBasicOps-680659397-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:09:58.087927 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-84ae8b88-d2db-4f23-8e66-291218ca02ad tempest-TestNetworkBasicOps-680659397 tempest-TestNetworkBasicOps-680659397-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:09:58.110730 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-84ae8b88-d2db-4f23-8e66-291218ca02ad tempest-TestNetworkBasicOps-680659397 tempest-TestNetworkBasicOps-680659397-project] [instance: ba394f20-f42c-43e4-b571-4a023cedbe4e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f5cdc3d5-9524-4220-a7fc-ab5606975fdb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94357) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 21 11:09:58.117432 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-84ae8b88-d2db-4f23-8e66-291218ca02ad tempest-TestNetworkBasicOps-680659397 tempest-TestNetworkBasicOps-680659397-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:09:58.117876 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-84ae8b88-d2db-4f23-8e66-291218ca02ad tempest-TestNetworkBasicOps-680659397 tempest-TestNetworkBasicOps-680659397-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:09:58.186398 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-84ae8b88-d2db-4f23-8e66-291218ca02ad tempest-TestNetworkBasicOps-680659397 tempest-TestNetworkBasicOps-680659397-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:09:58.186804 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-84ae8b88-d2db-4f23-8e66-291218ca02ad tempest-TestNetworkBasicOps-680659397 tempest-TestNetworkBasicOps-680659397-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:10:18.724253 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-553cb238-a240-418f-8641-359f22569fbe tempest-ServerActionsTestJSON-39410595 tempest-ServerActionsTestJSON-39410595-project] Took 0.59 seconds to select destinations for 1 instance(s). {{(pid=94358) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 21 11:10:18.809131 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-553cb238-a240-418f-8641-359f22569fbe tempest-ServerActionsTestJSON-39410595 tempest-ServerActionsTestJSON-39410595-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:10:18.811718 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-553cb238-a240-418f-8641-359f22569fbe tempest-ServerActionsTestJSON-39410595 tempest-ServerActionsTestJSON-39410595-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:10:18.981123 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-553cb238-a240-418f-8641-359f22569fbe tempest-ServerActionsTestJSON-39410595 tempest-ServerActionsTestJSON-39410595-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:10:18.981820 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-553cb238-a240-418f-8641-359f22569fbe tempest-ServerActionsTestJSON-39410595 tempest-ServerActionsTestJSON-39410595-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:10:18.982804 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-553cb238-a240-418f-8641-359f22569fbe tempest-ServerActionsTestJSON-39410595 tempest-ServerActionsTestJSON-39410595-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:10:18.983266 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-553cb238-a240-418f-8641-359f22569fbe tempest-ServerActionsTestJSON-39410595 tempest-ServerActionsTestJSON-39410595-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:10:19.039097 n-d-811414-3 nova-conductor[94358]: DEBUG nova.quota [None req-553cb238-a240-418f-8641-359f22569fbe tempest-ServerActionsTestJSON-39410595 tempest-ServerActionsTestJSON-39410595-project] Getting quotas for project 439cca9b7ac448f1bd53517ca1184188. Resources: {'instances', 'cores', 'ram'} {{(pid=94358) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 21 11:10:19.054665 n-d-811414-3 nova-conductor[94358]: DEBUG nova.quota [None req-553cb238-a240-418f-8641-359f22569fbe tempest-ServerActionsTestJSON-39410595 tempest-ServerActionsTestJSON-39410595-project] Getting quotas for user 677099018e3f4381a0eb5c606e46b6ec and project 439cca9b7ac448f1bd53517ca1184188. Resources: {'instances', 'cores', 'ram'} {{(pid=94358) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 21 11:10:19.094503 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-553cb238-a240-418f-8641-359f22569fbe tempest-ServerActionsTestJSON-39410595 tempest-ServerActionsTestJSON-39410595-project] [instance: e48b94cc-29f4-4cfc-b925-5e351938220e] Selected host: n-h2-811414-3; Selected node: n-h2-811414-3; Alternates: [('n-h1-811414-3', 'n-h1-811414-3')] {{(pid=94358) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 21 11:10:19.103920 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-553cb238-a240-418f-8641-359f22569fbe tempest-ServerActionsTestJSON-39410595 tempest-ServerActionsTestJSON-39410595-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:10:19.104352 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-553cb238-a240-418f-8641-359f22569fbe tempest-ServerActionsTestJSON-39410595 tempest-ServerActionsTestJSON-39410595-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:10:19.115602 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-553cb238-a240-418f-8641-359f22569fbe tempest-ServerActionsTestJSON-39410595 tempest-ServerActionsTestJSON-39410595-project] [instance: e48b94cc-29f4-4cfc-b925-5e351938220e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f5cdc3d5-9524-4220-a7fc-ab5606975fdb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94358) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 21 11:10:19.117266 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-553cb238-a240-418f-8641-359f22569fbe tempest-ServerActionsTestJSON-39410595 tempest-ServerActionsTestJSON-39410595-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:10:19.118019 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-553cb238-a240-418f-8641-359f22569fbe tempest-ServerActionsTestJSON-39410595 tempest-ServerActionsTestJSON-39410595-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:10:19.194787 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-553cb238-a240-418f-8641-359f22569fbe tempest-ServerActionsTestJSON-39410595 tempest-ServerActionsTestJSON-39410595-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:10:19.195430 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-553cb238-a240-418f-8641-359f22569fbe tempest-ServerActionsTestJSON-39410595 tempest-ServerActionsTestJSON-39410595-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:10:25.798991 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-1efc37ef-a68a-4491-86de-72cd7f3bc35f tempest-VolumesSnapshotTestJSON-2000754355 tempest-VolumesSnapshotTestJSON-2000754355-project] Took 0.44 seconds to select destinations for 1 instance(s). {{(pid=94357) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 21 11:10:25.853496 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-1efc37ef-a68a-4491-86de-72cd7f3bc35f tempest-VolumesSnapshotTestJSON-2000754355 tempest-VolumesSnapshotTestJSON-2000754355-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:10:25.854039 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-1efc37ef-a68a-4491-86de-72cd7f3bc35f tempest-VolumesSnapshotTestJSON-2000754355 tempest-VolumesSnapshotTestJSON-2000754355-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:10:25.996718 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-1efc37ef-a68a-4491-86de-72cd7f3bc35f tempest-VolumesSnapshotTestJSON-2000754355 tempest-VolumesSnapshotTestJSON-2000754355-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:10:25.997343 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-1efc37ef-a68a-4491-86de-72cd7f3bc35f tempest-VolumesSnapshotTestJSON-2000754355 tempest-VolumesSnapshotTestJSON-2000754355-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:10:25.998165 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-1efc37ef-a68a-4491-86de-72cd7f3bc35f tempest-VolumesSnapshotTestJSON-2000754355 tempest-VolumesSnapshotTestJSON-2000754355-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:10:26.005769 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-1efc37ef-a68a-4491-86de-72cd7f3bc35f tempest-VolumesSnapshotTestJSON-2000754355 tempest-VolumesSnapshotTestJSON-2000754355-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:10:26.055966 n-d-811414-3 nova-conductor[94357]: DEBUG nova.quota [None req-1efc37ef-a68a-4491-86de-72cd7f3bc35f tempest-VolumesSnapshotTestJSON-2000754355 tempest-VolumesSnapshotTestJSON-2000754355-project] Getting quotas for project 50a68354e54a4ab1aed532d15b7992b9. Resources: {'instances', 'cores', 'ram'} {{(pid=94357) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 21 11:10:26.065786 n-d-811414-3 nova-conductor[94357]: DEBUG nova.quota [None req-1efc37ef-a68a-4491-86de-72cd7f3bc35f tempest-VolumesSnapshotTestJSON-2000754355 tempest-VolumesSnapshotTestJSON-2000754355-project] Getting quotas for user 9de035d5d394411eb2b7cb46e2b06b13 and project 50a68354e54a4ab1aed532d15b7992b9. Resources: {'instances', 'cores', 'ram'} {{(pid=94357) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 21 11:10:26.092692 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-1efc37ef-a68a-4491-86de-72cd7f3bc35f tempest-VolumesSnapshotTestJSON-2000754355 tempest-VolumesSnapshotTestJSON-2000754355-project] [instance: 197b6ea8-2613-4b61-80fa-159847d577ac] Selected host: n-h2-811414-3; Selected node: n-h2-811414-3; Alternates: [('n-h1-811414-3', 'n-h1-811414-3')] {{(pid=94357) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 21 11:10:26.093941 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-1efc37ef-a68a-4491-86de-72cd7f3bc35f tempest-VolumesSnapshotTestJSON-2000754355 tempest-VolumesSnapshotTestJSON-2000754355-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:10:26.094547 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-1efc37ef-a68a-4491-86de-72cd7f3bc35f tempest-VolumesSnapshotTestJSON-2000754355 tempest-VolumesSnapshotTestJSON-2000754355-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:10:26.111179 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-1efc37ef-a68a-4491-86de-72cd7f3bc35f tempest-VolumesSnapshotTestJSON-2000754355 tempest-VolumesSnapshotTestJSON-2000754355-project] [instance: 197b6ea8-2613-4b61-80fa-159847d577ac] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f5cdc3d5-9524-4220-a7fc-ab5606975fdb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94357) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 21 11:10:26.113038 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-1efc37ef-a68a-4491-86de-72cd7f3bc35f tempest-VolumesSnapshotTestJSON-2000754355 tempest-VolumesSnapshotTestJSON-2000754355-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:10:26.113697 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-1efc37ef-a68a-4491-86de-72cd7f3bc35f tempest-VolumesSnapshotTestJSON-2000754355 tempest-VolumesSnapshotTestJSON-2000754355-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:10:26.165734 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-1efc37ef-a68a-4491-86de-72cd7f3bc35f tempest-VolumesSnapshotTestJSON-2000754355 tempest-VolumesSnapshotTestJSON-2000754355-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:10:26.167610 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-1efc37ef-a68a-4491-86de-72cd7f3bc35f tempest-VolumesSnapshotTestJSON-2000754355 tempest-VolumesSnapshotTestJSON-2000754355-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:10:31.448234 n-d-811414-3 nova-conductor[94357]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 21 11:11:40.057089 n-d-811414-3 nova-conductor[94358]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f60095b5-b68f-459e-af9a-3776dcd48c13] AMQP server on 10.222.0.13:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Apr 21 11:11:41.082204 n-d-811414-3 nova-conductor[94358]: INFO oslo.messaging._drivers.impl_rabbit [-] [f60095b5-b68f-459e-af9a-3776dcd48c13] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 55162. Apr 21 11:11:51.492996 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-273e91ab-bf06-41e8-b63e-093709f7dea8 tempest-TestNetworkBasicOps-680659397 tempest-TestNetworkBasicOps-680659397-project] Took 0.36 seconds to select destinations for 1 instance(s). {{(pid=94358) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 21 11:11:51.533892 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-273e91ab-bf06-41e8-b63e-093709f7dea8 tempest-TestNetworkBasicOps-680659397 tempest-TestNetworkBasicOps-680659397-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:11:51.534694 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-273e91ab-bf06-41e8-b63e-093709f7dea8 tempest-TestNetworkBasicOps-680659397 tempest-TestNetworkBasicOps-680659397-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:11:51.602182 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-273e91ab-bf06-41e8-b63e-093709f7dea8 tempest-TestNetworkBasicOps-680659397 tempest-TestNetworkBasicOps-680659397-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:11:51.606290 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-273e91ab-bf06-41e8-b63e-093709f7dea8 tempest-TestNetworkBasicOps-680659397 tempest-TestNetworkBasicOps-680659397-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:11:51.608064 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-273e91ab-bf06-41e8-b63e-093709f7dea8 tempest-TestNetworkBasicOps-680659397 tempest-TestNetworkBasicOps-680659397-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:11:51.608819 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-273e91ab-bf06-41e8-b63e-093709f7dea8 tempest-TestNetworkBasicOps-680659397 tempest-TestNetworkBasicOps-680659397-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:11:51.632785 n-d-811414-3 nova-conductor[94358]: DEBUG nova.quota [None req-273e91ab-bf06-41e8-b63e-093709f7dea8 tempest-TestNetworkBasicOps-680659397 tempest-TestNetworkBasicOps-680659397-project] Getting quotas for project 8bc20f1ee62f44ae95dbe2010ec7635f. Resources: {'instances', 'cores', 'ram'} {{(pid=94358) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 21 11:11:51.640844 n-d-811414-3 nova-conductor[94358]: DEBUG nova.quota [None req-273e91ab-bf06-41e8-b63e-093709f7dea8 tempest-TestNetworkBasicOps-680659397 tempest-TestNetworkBasicOps-680659397-project] Getting quotas for user b94d5357b2dd4d3f9dbfc2cd7957ebd2 and project 8bc20f1ee62f44ae95dbe2010ec7635f. Resources: {'instances', 'cores', 'ram'} {{(pid=94358) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 21 11:11:51.670773 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-273e91ab-bf06-41e8-b63e-093709f7dea8 tempest-TestNetworkBasicOps-680659397 tempest-TestNetworkBasicOps-680659397-project] [instance: 7a14ebc2-f41e-4526-9822-70745aa14719] Selected host: n-h1-811414-3; Selected node: n-h1-811414-3; Alternates: [('n-h2-811414-3', 'n-h2-811414-3')] {{(pid=94358) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 21 11:11:51.673357 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-273e91ab-bf06-41e8-b63e-093709f7dea8 tempest-TestNetworkBasicOps-680659397 tempest-TestNetworkBasicOps-680659397-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:11:51.673928 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-273e91ab-bf06-41e8-b63e-093709f7dea8 tempest-TestNetworkBasicOps-680659397 tempest-TestNetworkBasicOps-680659397-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:11:51.684611 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-273e91ab-bf06-41e8-b63e-093709f7dea8 tempest-TestNetworkBasicOps-680659397 tempest-TestNetworkBasicOps-680659397-project] [instance: 7a14ebc2-f41e-4526-9822-70745aa14719] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f5cdc3d5-9524-4220-a7fc-ab5606975fdb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94358) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 21 11:11:51.687967 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-273e91ab-bf06-41e8-b63e-093709f7dea8 tempest-TestNetworkBasicOps-680659397 tempest-TestNetworkBasicOps-680659397-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:11:51.688624 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-273e91ab-bf06-41e8-b63e-093709f7dea8 tempest-TestNetworkBasicOps-680659397 tempest-TestNetworkBasicOps-680659397-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:11:51.753150 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-273e91ab-bf06-41e8-b63e-093709f7dea8 tempest-TestNetworkBasicOps-680659397 tempest-TestNetworkBasicOps-680659397-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:11:51.753768 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-273e91ab-bf06-41e8-b63e-093709f7dea8 tempest-TestNetworkBasicOps-680659397 tempest-TestNetworkBasicOps-680659397-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:11:57.755692 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-c1ce1e00-ad63-4ae9-b0c9-3459c3e19c2e tempest-TestVolumeBackupRestore-906108187 tempest-TestVolumeBackupRestore-906108187-project] Took 0.67 seconds to select destinations for 1 instance(s). {{(pid=94357) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 21 11:11:57.827361 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-c1ce1e00-ad63-4ae9-b0c9-3459c3e19c2e tempest-TestVolumeBackupRestore-906108187 tempest-TestVolumeBackupRestore-906108187-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:11:57.829314 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-c1ce1e00-ad63-4ae9-b0c9-3459c3e19c2e tempest-TestVolumeBackupRestore-906108187 tempest-TestVolumeBackupRestore-906108187-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:11:57.943971 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-c1ce1e00-ad63-4ae9-b0c9-3459c3e19c2e tempest-TestVolumeBackupRestore-906108187 tempest-TestVolumeBackupRestore-906108187-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:11:57.944263 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-c1ce1e00-ad63-4ae9-b0c9-3459c3e19c2e tempest-TestVolumeBackupRestore-906108187 tempest-TestVolumeBackupRestore-906108187-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:11:57.945023 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-c1ce1e00-ad63-4ae9-b0c9-3459c3e19c2e tempest-TestVolumeBackupRestore-906108187 tempest-TestVolumeBackupRestore-906108187-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:11:57.945404 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-c1ce1e00-ad63-4ae9-b0c9-3459c3e19c2e tempest-TestVolumeBackupRestore-906108187 tempest-TestVolumeBackupRestore-906108187-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:11:57.982872 n-d-811414-3 nova-conductor[94357]: DEBUG nova.quota [None req-c1ce1e00-ad63-4ae9-b0c9-3459c3e19c2e tempest-TestVolumeBackupRestore-906108187 tempest-TestVolumeBackupRestore-906108187-project] Getting quotas for project 48de12e9a55c479fabbde9eb486bd6ab. Resources: {'instances', 'cores', 'ram'} {{(pid=94357) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 21 11:11:57.998259 n-d-811414-3 nova-conductor[94357]: DEBUG nova.quota [None req-c1ce1e00-ad63-4ae9-b0c9-3459c3e19c2e tempest-TestVolumeBackupRestore-906108187 tempest-TestVolumeBackupRestore-906108187-project] Getting quotas for user d20a1a7b1bda49159b36b19900dbfa31 and project 48de12e9a55c479fabbde9eb486bd6ab. Resources: {'instances', 'cores', 'ram'} {{(pid=94357) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 21 11:11:58.016751 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-c1ce1e00-ad63-4ae9-b0c9-3459c3e19c2e tempest-TestVolumeBackupRestore-906108187 tempest-TestVolumeBackupRestore-906108187-project] [instance: a3f770a6-7673-4930-8c90-08da3a300e01] Selected host: n-h2-811414-3; Selected node: n-h2-811414-3; Alternates: [('n-h1-811414-3', 'n-h1-811414-3')] {{(pid=94357) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 21 11:11:58.023498 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-c1ce1e00-ad63-4ae9-b0c9-3459c3e19c2e tempest-TestVolumeBackupRestore-906108187 tempest-TestVolumeBackupRestore-906108187-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:11:58.023914 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-c1ce1e00-ad63-4ae9-b0c9-3459c3e19c2e tempest-TestVolumeBackupRestore-906108187 tempest-TestVolumeBackupRestore-906108187-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:11:58.035745 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-c1ce1e00-ad63-4ae9-b0c9-3459c3e19c2e tempest-TestVolumeBackupRestore-906108187 tempest-TestVolumeBackupRestore-906108187-project] [instance: a3f770a6-7673-4930-8c90-08da3a300e01] block_device_mapping [BlockDeviceMapping(attachment_id=e2c4c7c8-17d3-4d6d-b399-a8c01cc135e1,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='069bde3f-e5ae-4266-b2d7-c0f12d179029',volume_size=1,volume_type=None)] {{(pid=94357) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 21 11:11:58.037059 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-c1ce1e00-ad63-4ae9-b0c9-3459c3e19c2e tempest-TestVolumeBackupRestore-906108187 tempest-TestVolumeBackupRestore-906108187-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:11:58.037469 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-c1ce1e00-ad63-4ae9-b0c9-3459c3e19c2e tempest-TestVolumeBackupRestore-906108187 tempest-TestVolumeBackupRestore-906108187-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:11:58.098539 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-c1ce1e00-ad63-4ae9-b0c9-3459c3e19c2e tempest-TestVolumeBackupRestore-906108187 tempest-TestVolumeBackupRestore-906108187-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:11:58.099375 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-c1ce1e00-ad63-4ae9-b0c9-3459c3e19c2e tempest-TestVolumeBackupRestore-906108187 tempest-TestVolumeBackupRestore-906108187-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:12:06.096211 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-538c7241-97fb-4a23-913f-627e6608f866 tempest-VolumesSnapshotTestJSON-2000754355 tempest-VolumesSnapshotTestJSON-2000754355-project] Took 0.29 seconds to select destinations for 1 instance(s). {{(pid=94358) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 21 11:12:06.123845 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-538c7241-97fb-4a23-913f-627e6608f866 tempest-VolumesSnapshotTestJSON-2000754355 tempest-VolumesSnapshotTestJSON-2000754355-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:12:06.124320 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-538c7241-97fb-4a23-913f-627e6608f866 tempest-VolumesSnapshotTestJSON-2000754355 tempest-VolumesSnapshotTestJSON-2000754355-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:12:06.189790 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-538c7241-97fb-4a23-913f-627e6608f866 tempest-VolumesSnapshotTestJSON-2000754355 tempest-VolumesSnapshotTestJSON-2000754355-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:12:06.190196 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-538c7241-97fb-4a23-913f-627e6608f866 tempest-VolumesSnapshotTestJSON-2000754355 tempest-VolumesSnapshotTestJSON-2000754355-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:12:06.191006 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-538c7241-97fb-4a23-913f-627e6608f866 tempest-VolumesSnapshotTestJSON-2000754355 tempest-VolumesSnapshotTestJSON-2000754355-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:12:06.191367 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-538c7241-97fb-4a23-913f-627e6608f866 tempest-VolumesSnapshotTestJSON-2000754355 tempest-VolumesSnapshotTestJSON-2000754355-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:12:06.227306 n-d-811414-3 nova-conductor[94358]: DEBUG nova.quota [None req-538c7241-97fb-4a23-913f-627e6608f866 tempest-VolumesSnapshotTestJSON-2000754355 tempest-VolumesSnapshotTestJSON-2000754355-project] Getting quotas for project 50a68354e54a4ab1aed532d15b7992b9. Resources: {'instances', 'cores', 'ram'} {{(pid=94358) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 21 11:12:06.237266 n-d-811414-3 nova-conductor[94358]: DEBUG nova.quota [None req-538c7241-97fb-4a23-913f-627e6608f866 tempest-VolumesSnapshotTestJSON-2000754355 tempest-VolumesSnapshotTestJSON-2000754355-project] Getting quotas for user 9de035d5d394411eb2b7cb46e2b06b13 and project 50a68354e54a4ab1aed532d15b7992b9. Resources: {'instances', 'cores', 'ram'} {{(pid=94358) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 21 11:12:06.263659 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-538c7241-97fb-4a23-913f-627e6608f866 tempest-VolumesSnapshotTestJSON-2000754355 tempest-VolumesSnapshotTestJSON-2000754355-project] [instance: bf800a3a-7f1a-4ca9-abb2-8fafa6777b9c] Selected host: n-h1-811414-3; Selected node: n-h1-811414-3; Alternates: [('n-h2-811414-3', 'n-h2-811414-3')] {{(pid=94358) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 21 11:12:06.264956 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-538c7241-97fb-4a23-913f-627e6608f866 tempest-VolumesSnapshotTestJSON-2000754355 tempest-VolumesSnapshotTestJSON-2000754355-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:12:06.278681 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-538c7241-97fb-4a23-913f-627e6608f866 tempest-VolumesSnapshotTestJSON-2000754355 tempest-VolumesSnapshotTestJSON-2000754355-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:12:06.290040 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-538c7241-97fb-4a23-913f-627e6608f866 tempest-VolumesSnapshotTestJSON-2000754355 tempest-VolumesSnapshotTestJSON-2000754355-project] [instance: bf800a3a-7f1a-4ca9-abb2-8fafa6777b9c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f5cdc3d5-9524-4220-a7fc-ab5606975fdb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94358) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 21 11:12:06.302304 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-538c7241-97fb-4a23-913f-627e6608f866 tempest-VolumesSnapshotTestJSON-2000754355 tempest-VolumesSnapshotTestJSON-2000754355-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:12:06.302886 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-538c7241-97fb-4a23-913f-627e6608f866 tempest-VolumesSnapshotTestJSON-2000754355 tempest-VolumesSnapshotTestJSON-2000754355-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:12:06.406939 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-538c7241-97fb-4a23-913f-627e6608f866 tempest-VolumesSnapshotTestJSON-2000754355 tempest-VolumesSnapshotTestJSON-2000754355-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:12:06.407695 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-538c7241-97fb-4a23-913f-627e6608f866 tempest-VolumesSnapshotTestJSON-2000754355 tempest-VolumesSnapshotTestJSON-2000754355-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:12:36.296750 n-d-811414-3 nova-conductor[94357]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6404cb3a-bdc9-481c-93a6-d63501b53d9b] AMQP server on 10.222.0.13:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Apr 21 11:12:36.589069 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-01a70b0c-265b-487e-90f0-894af9fb374e tempest-ServerActionsTestJSON-39410595 tempest-ServerActionsTestJSON-39410595-project] Took 0.36 seconds to select destinations for 1 instance(s). {{(pid=94357) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 21 11:12:36.617351 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-01a70b0c-265b-487e-90f0-894af9fb374e tempest-ServerActionsTestJSON-39410595 tempest-ServerActionsTestJSON-39410595-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:12:36.618291 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-01a70b0c-265b-487e-90f0-894af9fb374e tempest-ServerActionsTestJSON-39410595 tempest-ServerActionsTestJSON-39410595-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:12:36.673938 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-01a70b0c-265b-487e-90f0-894af9fb374e tempest-ServerActionsTestJSON-39410595 tempest-ServerActionsTestJSON-39410595-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:12:36.674347 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-01a70b0c-265b-487e-90f0-894af9fb374e tempest-ServerActionsTestJSON-39410595 tempest-ServerActionsTestJSON-39410595-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:12:36.675077 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-01a70b0c-265b-487e-90f0-894af9fb374e tempest-ServerActionsTestJSON-39410595 tempest-ServerActionsTestJSON-39410595-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:12:36.675468 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-01a70b0c-265b-487e-90f0-894af9fb374e tempest-ServerActionsTestJSON-39410595 tempest-ServerActionsTestJSON-39410595-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:12:36.701381 n-d-811414-3 nova-conductor[94357]: DEBUG nova.quota [None req-01a70b0c-265b-487e-90f0-894af9fb374e tempest-ServerActionsTestJSON-39410595 tempest-ServerActionsTestJSON-39410595-project] Getting quotas for project 439cca9b7ac448f1bd53517ca1184188. Resources: {'instances', 'cores', 'ram'} {{(pid=94357) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 21 11:12:36.707370 n-d-811414-3 nova-conductor[94357]: DEBUG nova.quota [None req-01a70b0c-265b-487e-90f0-894af9fb374e tempest-ServerActionsTestJSON-39410595 tempest-ServerActionsTestJSON-39410595-project] Getting quotas for user 677099018e3f4381a0eb5c606e46b6ec and project 439cca9b7ac448f1bd53517ca1184188. Resources: {'instances', 'cores', 'ram'} {{(pid=94357) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 21 11:12:36.724101 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-01a70b0c-265b-487e-90f0-894af9fb374e tempest-ServerActionsTestJSON-39410595 tempest-ServerActionsTestJSON-39410595-project] [instance: d953f84f-399b-405a-81d2-6b7e98d5ba82] Selected host: n-h2-811414-3; Selected node: n-h2-811414-3; Alternates: [('n-h1-811414-3', 'n-h1-811414-3')] {{(pid=94357) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 21 11:12:36.725247 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-01a70b0c-265b-487e-90f0-894af9fb374e tempest-ServerActionsTestJSON-39410595 tempest-ServerActionsTestJSON-39410595-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:12:36.725881 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-01a70b0c-265b-487e-90f0-894af9fb374e tempest-ServerActionsTestJSON-39410595 tempest-ServerActionsTestJSON-39410595-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:12:36.735073 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-01a70b0c-265b-487e-90f0-894af9fb374e tempest-ServerActionsTestJSON-39410595 tempest-ServerActionsTestJSON-39410595-project] [instance: d953f84f-399b-405a-81d2-6b7e98d5ba82] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f5cdc3d5-9524-4220-a7fc-ab5606975fdb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94357) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 21 11:12:36.736466 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-01a70b0c-265b-487e-90f0-894af9fb374e tempest-ServerActionsTestJSON-39410595 tempest-ServerActionsTestJSON-39410595-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:12:36.737005 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-01a70b0c-265b-487e-90f0-894af9fb374e tempest-ServerActionsTestJSON-39410595 tempest-ServerActionsTestJSON-39410595-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:12:36.771600 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-01a70b0c-265b-487e-90f0-894af9fb374e tempest-ServerActionsTestJSON-39410595 tempest-ServerActionsTestJSON-39410595-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:12:36.771995 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-01a70b0c-265b-487e-90f0-894af9fb374e tempest-ServerActionsTestJSON-39410595 tempest-ServerActionsTestJSON-39410595-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:12:37.311344 n-d-811414-3 nova-conductor[94357]: INFO oslo.messaging._drivers.impl_rabbit [-] [6404cb3a-bdc9-481c-93a6-d63501b53d9b] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 56076. Apr 21 11:12:58.355591 n-d-811414-3 nova-conductor[94358]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 21 11:13:09.695286 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-84fe23df-1a3d-4db2-b198-67f6e2e8abed tempest-ServerActionsTestJSON-39410595 tempest-ServerActionsTestJSON-39410595-project] Took 0.41 seconds to select destinations for 1 instance(s). {{(pid=94358) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 21 11:13:09.763795 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-84fe23df-1a3d-4db2-b198-67f6e2e8abed tempest-ServerActionsTestJSON-39410595 tempest-ServerActionsTestJSON-39410595-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:13:09.764587 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-84fe23df-1a3d-4db2-b198-67f6e2e8abed tempest-ServerActionsTestJSON-39410595 tempest-ServerActionsTestJSON-39410595-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:13:09.851435 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-84fe23df-1a3d-4db2-b198-67f6e2e8abed tempest-ServerActionsTestJSON-39410595 tempest-ServerActionsTestJSON-39410595-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:13:09.852213 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-84fe23df-1a3d-4db2-b198-67f6e2e8abed tempest-ServerActionsTestJSON-39410595 tempest-ServerActionsTestJSON-39410595-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:13:09.856626 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-84fe23df-1a3d-4db2-b198-67f6e2e8abed tempest-ServerActionsTestJSON-39410595 tempest-ServerActionsTestJSON-39410595-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:13:09.857422 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-84fe23df-1a3d-4db2-b198-67f6e2e8abed tempest-ServerActionsTestJSON-39410595 tempest-ServerActionsTestJSON-39410595-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:13:09.901006 n-d-811414-3 nova-conductor[94358]: DEBUG nova.quota [None req-84fe23df-1a3d-4db2-b198-67f6e2e8abed tempest-ServerActionsTestJSON-39410595 tempest-ServerActionsTestJSON-39410595-project] Getting quotas for project 439cca9b7ac448f1bd53517ca1184188. Resources: {'instances', 'cores', 'ram'} {{(pid=94358) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 21 11:13:09.916861 n-d-811414-3 nova-conductor[94358]: DEBUG nova.quota [None req-84fe23df-1a3d-4db2-b198-67f6e2e8abed tempest-ServerActionsTestJSON-39410595 tempest-ServerActionsTestJSON-39410595-project] Getting quotas for user 677099018e3f4381a0eb5c606e46b6ec and project 439cca9b7ac448f1bd53517ca1184188. Resources: {'instances', 'cores', 'ram'} {{(pid=94358) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 21 11:13:09.940084 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-84fe23df-1a3d-4db2-b198-67f6e2e8abed tempest-ServerActionsTestJSON-39410595 tempest-ServerActionsTestJSON-39410595-project] [instance: e977dacc-b576-4433-810f-0d9b755c2de2] Selected host: n-h1-811414-3; Selected node: n-h1-811414-3; Alternates: [('n-h2-811414-3', 'n-h2-811414-3')] {{(pid=94358) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 21 11:13:09.941976 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-84fe23df-1a3d-4db2-b198-67f6e2e8abed tempest-ServerActionsTestJSON-39410595 tempest-ServerActionsTestJSON-39410595-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:13:09.942673 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-84fe23df-1a3d-4db2-b198-67f6e2e8abed tempest-ServerActionsTestJSON-39410595 tempest-ServerActionsTestJSON-39410595-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:13:09.951817 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-84fe23df-1a3d-4db2-b198-67f6e2e8abed tempest-ServerActionsTestJSON-39410595 tempest-ServerActionsTestJSON-39410595-project] [instance: e977dacc-b576-4433-810f-0d9b755c2de2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f5cdc3d5-9524-4220-a7fc-ab5606975fdb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94358) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 21 11:13:09.953806 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-84fe23df-1a3d-4db2-b198-67f6e2e8abed tempest-ServerActionsTestJSON-39410595 tempest-ServerActionsTestJSON-39410595-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:13:09.954557 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-84fe23df-1a3d-4db2-b198-67f6e2e8abed tempest-ServerActionsTestJSON-39410595 tempest-ServerActionsTestJSON-39410595-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:13:10.012505 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-84fe23df-1a3d-4db2-b198-67f6e2e8abed tempest-ServerActionsTestJSON-39410595 tempest-ServerActionsTestJSON-39410595-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:13:10.013075 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-84fe23df-1a3d-4db2-b198-67f6e2e8abed tempest-ServerActionsTestJSON-39410595 tempest-ServerActionsTestJSON-39410595-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:13:51.456682 n-d-811414-3 nova-conductor[94357]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 21 11:14:00.701938 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-402c11ce-93bf-425a-b73f-d12d4c17d021 tempest-TestSecurityGroupsBasicOps-823484942 tempest-TestSecurityGroupsBasicOps-823484942-project] Took 0.54 seconds to select destinations for 1 instance(s). {{(pid=94357) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 21 11:14:00.785686 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-402c11ce-93bf-425a-b73f-d12d4c17d021 tempest-TestSecurityGroupsBasicOps-823484942 tempest-TestSecurityGroupsBasicOps-823484942-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:14:00.786107 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-402c11ce-93bf-425a-b73f-d12d4c17d021 tempest-TestSecurityGroupsBasicOps-823484942 tempest-TestSecurityGroupsBasicOps-823484942-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:14:00.927794 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-402c11ce-93bf-425a-b73f-d12d4c17d021 tempest-TestSecurityGroupsBasicOps-823484942 tempest-TestSecurityGroupsBasicOps-823484942-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:14:00.928377 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-402c11ce-93bf-425a-b73f-d12d4c17d021 tempest-TestSecurityGroupsBasicOps-823484942 tempest-TestSecurityGroupsBasicOps-823484942-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:14:00.930059 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-402c11ce-93bf-425a-b73f-d12d4c17d021 tempest-TestSecurityGroupsBasicOps-823484942 tempest-TestSecurityGroupsBasicOps-823484942-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:14:00.930894 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-402c11ce-93bf-425a-b73f-d12d4c17d021 tempest-TestSecurityGroupsBasicOps-823484942 tempest-TestSecurityGroupsBasicOps-823484942-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:14:00.965098 n-d-811414-3 nova-conductor[94357]: DEBUG nova.quota [None req-402c11ce-93bf-425a-b73f-d12d4c17d021 tempest-TestSecurityGroupsBasicOps-823484942 tempest-TestSecurityGroupsBasicOps-823484942-project] Getting quotas for project 951126fc27f947b8a314a155c53169ca. Resources: {'instances', 'cores', 'ram'} {{(pid=94357) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 21 11:14:00.974326 n-d-811414-3 nova-conductor[94357]: DEBUG nova.quota [None req-402c11ce-93bf-425a-b73f-d12d4c17d021 tempest-TestSecurityGroupsBasicOps-823484942 tempest-TestSecurityGroupsBasicOps-823484942-project] Getting quotas for user 8802f5b276c2444885141a5fd774d535 and project 951126fc27f947b8a314a155c53169ca. Resources: {'instances', 'cores', 'ram'} {{(pid=94357) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 21 11:14:00.999192 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-402c11ce-93bf-425a-b73f-d12d4c17d021 tempest-TestSecurityGroupsBasicOps-823484942 tempest-TestSecurityGroupsBasicOps-823484942-project] [instance: 75a172c5-a8c6-46c3-b500-c01d140bda63] Selected host: n-h2-811414-3; Selected node: n-h2-811414-3; Alternates: [('n-h1-811414-3', 'n-h1-811414-3')] {{(pid=94357) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 21 11:14:01.000599 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-402c11ce-93bf-425a-b73f-d12d4c17d021 tempest-TestSecurityGroupsBasicOps-823484942 tempest-TestSecurityGroupsBasicOps-823484942-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:14:01.001162 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-402c11ce-93bf-425a-b73f-d12d4c17d021 tempest-TestSecurityGroupsBasicOps-823484942 tempest-TestSecurityGroupsBasicOps-823484942-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:14:01.018097 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-402c11ce-93bf-425a-b73f-d12d4c17d021 tempest-TestSecurityGroupsBasicOps-823484942 tempest-TestSecurityGroupsBasicOps-823484942-project] [instance: 75a172c5-a8c6-46c3-b500-c01d140bda63] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f5cdc3d5-9524-4220-a7fc-ab5606975fdb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94357) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 21 11:14:01.019766 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-402c11ce-93bf-425a-b73f-d12d4c17d021 tempest-TestSecurityGroupsBasicOps-823484942 tempest-TestSecurityGroupsBasicOps-823484942-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:14:01.020368 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-402c11ce-93bf-425a-b73f-d12d4c17d021 tempest-TestSecurityGroupsBasicOps-823484942 tempest-TestSecurityGroupsBasicOps-823484942-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:14:01.068360 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-402c11ce-93bf-425a-b73f-d12d4c17d021 tempest-TestSecurityGroupsBasicOps-823484942 tempest-TestSecurityGroupsBasicOps-823484942-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:14:01.069045 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-402c11ce-93bf-425a-b73f-d12d4c17d021 tempest-TestSecurityGroupsBasicOps-823484942 tempest-TestSecurityGroupsBasicOps-823484942-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:14:41.065484 n-d-811414-3 nova-conductor[94358]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f60095b5-b68f-459e-af9a-3776dcd48c13] AMQP server on 10.222.0.13:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Apr 21 11:14:42.074512 n-d-811414-3 nova-conductor[94358]: INFO oslo.messaging._drivers.impl_rabbit [-] [f60095b5-b68f-459e-af9a-3776dcd48c13] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 58368. Apr 21 11:14:50.654894 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-aeb2ac71-f396-45b1-8a25-23677c12fada tempest-TestVolumeBootPattern-1683621464 tempest-TestVolumeBootPattern-1683621464-project] Took 0.46 seconds to select destinations for 1 instance(s). {{(pid=94358) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 21 11:14:50.697914 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-aeb2ac71-f396-45b1-8a25-23677c12fada tempest-TestVolumeBootPattern-1683621464 tempest-TestVolumeBootPattern-1683621464-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:14:50.698327 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-aeb2ac71-f396-45b1-8a25-23677c12fada tempest-TestVolumeBootPattern-1683621464 tempest-TestVolumeBootPattern-1683621464-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:14:50.804567 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-aeb2ac71-f396-45b1-8a25-23677c12fada tempest-TestVolumeBootPattern-1683621464 tempest-TestVolumeBootPattern-1683621464-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:14:50.804990 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-aeb2ac71-f396-45b1-8a25-23677c12fada tempest-TestVolumeBootPattern-1683621464 tempest-TestVolumeBootPattern-1683621464-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:14:50.805713 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-aeb2ac71-f396-45b1-8a25-23677c12fada tempest-TestVolumeBootPattern-1683621464 tempest-TestVolumeBootPattern-1683621464-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:14:50.806102 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-aeb2ac71-f396-45b1-8a25-23677c12fada tempest-TestVolumeBootPattern-1683621464 tempest-TestVolumeBootPattern-1683621464-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:14:50.825009 n-d-811414-3 nova-conductor[94358]: DEBUG nova.quota [None req-aeb2ac71-f396-45b1-8a25-23677c12fada tempest-TestVolumeBootPattern-1683621464 tempest-TestVolumeBootPattern-1683621464-project] Getting quotas for project eb539520fc5e47a8b097c107b50f602c. Resources: {'instances', 'cores', 'ram'} {{(pid=94358) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 21 11:14:50.830115 n-d-811414-3 nova-conductor[94358]: DEBUG nova.quota [None req-aeb2ac71-f396-45b1-8a25-23677c12fada tempest-TestVolumeBootPattern-1683621464 tempest-TestVolumeBootPattern-1683621464-project] Getting quotas for user 5ccc090867c04164a1429e908a4913cc and project eb539520fc5e47a8b097c107b50f602c. Resources: {'instances', 'cores', 'ram'} {{(pid=94358) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 21 11:14:50.843078 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-aeb2ac71-f396-45b1-8a25-23677c12fada tempest-TestVolumeBootPattern-1683621464 tempest-TestVolumeBootPattern-1683621464-project] [instance: 6f37fa2b-ff6c-4605-b0ac-e9d5b0da4595] Selected host: n-h1-811414-3; Selected node: n-h1-811414-3; Alternates: [('n-h2-811414-3', 'n-h2-811414-3')] {{(pid=94358) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 21 11:14:50.844293 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-aeb2ac71-f396-45b1-8a25-23677c12fada tempest-TestVolumeBootPattern-1683621464 tempest-TestVolumeBootPattern-1683621464-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:14:50.845040 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-aeb2ac71-f396-45b1-8a25-23677c12fada tempest-TestVolumeBootPattern-1683621464 tempest-TestVolumeBootPattern-1683621464-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:14:50.854426 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-aeb2ac71-f396-45b1-8a25-23677c12fada tempest-TestVolumeBootPattern-1683621464 tempest-TestVolumeBootPattern-1683621464-project] [instance: 6f37fa2b-ff6c-4605-b0ac-e9d5b0da4595] block_device_mapping [BlockDeviceMapping(attachment_id=e2306de7-c8da-43ea-b79c-5afd934f405b,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='74c14e6d-e1ba-4825-9b02-ac87201af805',volume_size=1,volume_type=None)] {{(pid=94358) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 21 11:14:50.856628 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-aeb2ac71-f396-45b1-8a25-23677c12fada tempest-TestVolumeBootPattern-1683621464 tempest-TestVolumeBootPattern-1683621464-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:14:50.857213 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-aeb2ac71-f396-45b1-8a25-23677c12fada tempest-TestVolumeBootPattern-1683621464 tempest-TestVolumeBootPattern-1683621464-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:14:50.894797 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-aeb2ac71-f396-45b1-8a25-23677c12fada tempest-TestVolumeBootPattern-1683621464 tempest-TestVolumeBootPattern-1683621464-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:14:50.895543 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-aeb2ac71-f396-45b1-8a25-23677c12fada tempest-TestVolumeBootPattern-1683621464 tempest-TestVolumeBootPattern-1683621464-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:15:05.016693 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-124c5530-aeaf-452e-be9d-ee1e702adc72 tempest-TestNetworkAdvancedServerOps-151663419 tempest-TestNetworkAdvancedServerOps-151663419-project] Took 0.55 seconds to select destinations for 1 instance(s). {{(pid=94357) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 21 11:15:05.041849 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-124c5530-aeaf-452e-be9d-ee1e702adc72 tempest-TestNetworkAdvancedServerOps-151663419 tempest-TestNetworkAdvancedServerOps-151663419-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:15:05.042247 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-124c5530-aeaf-452e-be9d-ee1e702adc72 tempest-TestNetworkAdvancedServerOps-151663419 tempest-TestNetworkAdvancedServerOps-151663419-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:15:05.123175 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-124c5530-aeaf-452e-be9d-ee1e702adc72 tempest-TestNetworkAdvancedServerOps-151663419 tempest-TestNetworkAdvancedServerOps-151663419-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:15:05.123577 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-124c5530-aeaf-452e-be9d-ee1e702adc72 tempest-TestNetworkAdvancedServerOps-151663419 tempest-TestNetworkAdvancedServerOps-151663419-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:15:05.124293 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-124c5530-aeaf-452e-be9d-ee1e702adc72 tempest-TestNetworkAdvancedServerOps-151663419 tempest-TestNetworkAdvancedServerOps-151663419-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:15:05.127422 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-124c5530-aeaf-452e-be9d-ee1e702adc72 tempest-TestNetworkAdvancedServerOps-151663419 tempest-TestNetworkAdvancedServerOps-151663419-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:15:05.169717 n-d-811414-3 nova-conductor[94357]: DEBUG nova.quota [None req-124c5530-aeaf-452e-be9d-ee1e702adc72 tempest-TestNetworkAdvancedServerOps-151663419 tempest-TestNetworkAdvancedServerOps-151663419-project] Getting quotas for project 2cd24407ec634f049086868ad62d3916. Resources: {'instances', 'cores', 'ram'} {{(pid=94357) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 21 11:15:05.185529 n-d-811414-3 nova-conductor[94357]: DEBUG nova.quota [None req-124c5530-aeaf-452e-be9d-ee1e702adc72 tempest-TestNetworkAdvancedServerOps-151663419 tempest-TestNetworkAdvancedServerOps-151663419-project] Getting quotas for user 7353f8631717442ab4e8c6704e3b3708 and project 2cd24407ec634f049086868ad62d3916. Resources: {'instances', 'cores', 'ram'} {{(pid=94357) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 21 11:15:05.218604 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-124c5530-aeaf-452e-be9d-ee1e702adc72 tempest-TestNetworkAdvancedServerOps-151663419 tempest-TestNetworkAdvancedServerOps-151663419-project] [instance: 17858db6-b7e8-4af7-a6e3-275dc919730f] Selected host: n-h2-811414-3; Selected node: n-h2-811414-3; Alternates: [('n-h1-811414-3', 'n-h1-811414-3')] {{(pid=94357) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 21 11:15:05.221895 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-124c5530-aeaf-452e-be9d-ee1e702adc72 tempest-TestNetworkAdvancedServerOps-151663419 tempest-TestNetworkAdvancedServerOps-151663419-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:15:05.222297 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-124c5530-aeaf-452e-be9d-ee1e702adc72 tempest-TestNetworkAdvancedServerOps-151663419 tempest-TestNetworkAdvancedServerOps-151663419-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:15:05.240052 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-124c5530-aeaf-452e-be9d-ee1e702adc72 tempest-TestNetworkAdvancedServerOps-151663419 tempest-TestNetworkAdvancedServerOps-151663419-project] [instance: 17858db6-b7e8-4af7-a6e3-275dc919730f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f5cdc3d5-9524-4220-a7fc-ab5606975fdb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94357) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 21 11:15:05.242145 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-124c5530-aeaf-452e-be9d-ee1e702adc72 tempest-TestNetworkAdvancedServerOps-151663419 tempest-TestNetworkAdvancedServerOps-151663419-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:15:05.242554 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-124c5530-aeaf-452e-be9d-ee1e702adc72 tempest-TestNetworkAdvancedServerOps-151663419 tempest-TestNetworkAdvancedServerOps-151663419-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:15:05.299214 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-124c5530-aeaf-452e-be9d-ee1e702adc72 tempest-TestNetworkAdvancedServerOps-151663419 tempest-TestNetworkAdvancedServerOps-151663419-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:15:05.300086 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-124c5530-aeaf-452e-be9d-ee1e702adc72 tempest-TestNetworkAdvancedServerOps-151663419 tempest-TestNetworkAdvancedServerOps-151663419-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:15:33.236145 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-4d2de9d4-2719-42a4-bdbf-9f613aa8ff33 tempest-TestSecurityGroupsBasicOps-823484942 tempest-TestSecurityGroupsBasicOps-823484942-project] Took 0.48 seconds to select destinations for 1 instance(s). {{(pid=94358) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 21 11:15:33.315512 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-4d2de9d4-2719-42a4-bdbf-9f613aa8ff33 tempest-TestSecurityGroupsBasicOps-823484942 tempest-TestSecurityGroupsBasicOps-823484942-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:15:33.319127 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-4d2de9d4-2719-42a4-bdbf-9f613aa8ff33 tempest-TestSecurityGroupsBasicOps-823484942 tempest-TestSecurityGroupsBasicOps-823484942-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:15:33.494986 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-4d2de9d4-2719-42a4-bdbf-9f613aa8ff33 tempest-TestSecurityGroupsBasicOps-823484942 tempest-TestSecurityGroupsBasicOps-823484942-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:15:33.495448 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-4d2de9d4-2719-42a4-bdbf-9f613aa8ff33 tempest-TestSecurityGroupsBasicOps-823484942 tempest-TestSecurityGroupsBasicOps-823484942-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:15:33.502709 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-4d2de9d4-2719-42a4-bdbf-9f613aa8ff33 tempest-TestSecurityGroupsBasicOps-823484942 tempest-TestSecurityGroupsBasicOps-823484942-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:15:33.504306 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-4d2de9d4-2719-42a4-bdbf-9f613aa8ff33 tempest-TestSecurityGroupsBasicOps-823484942 tempest-TestSecurityGroupsBasicOps-823484942-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:15:33.562831 n-d-811414-3 nova-conductor[94358]: DEBUG nova.quota [None req-4d2de9d4-2719-42a4-bdbf-9f613aa8ff33 tempest-TestSecurityGroupsBasicOps-823484942 tempest-TestSecurityGroupsBasicOps-823484942-project] Getting quotas for project 951126fc27f947b8a314a155c53169ca. Resources: {'instances', 'cores', 'ram'} {{(pid=94358) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 21 11:15:33.575838 n-d-811414-3 nova-conductor[94358]: DEBUG nova.quota [None req-4d2de9d4-2719-42a4-bdbf-9f613aa8ff33 tempest-TestSecurityGroupsBasicOps-823484942 tempest-TestSecurityGroupsBasicOps-823484942-project] Getting quotas for user 8802f5b276c2444885141a5fd774d535 and project 951126fc27f947b8a314a155c53169ca. Resources: {'instances', 'cores', 'ram'} {{(pid=94358) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 21 11:15:33.613285 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-4d2de9d4-2719-42a4-bdbf-9f613aa8ff33 tempest-TestSecurityGroupsBasicOps-823484942 tempest-TestSecurityGroupsBasicOps-823484942-project] [instance: 94257f91-9f2d-4cb4-b7f2-37d9a68758ed] Selected host: n-h1-811414-3; Selected node: n-h1-811414-3; Alternates: [] {{(pid=94358) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 21 11:15:33.614497 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-4d2de9d4-2719-42a4-bdbf-9f613aa8ff33 tempest-TestSecurityGroupsBasicOps-823484942 tempest-TestSecurityGroupsBasicOps-823484942-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:15:33.615044 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-4d2de9d4-2719-42a4-bdbf-9f613aa8ff33 tempest-TestSecurityGroupsBasicOps-823484942 tempest-TestSecurityGroupsBasicOps-823484942-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:15:33.626693 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-4d2de9d4-2719-42a4-bdbf-9f613aa8ff33 tempest-TestSecurityGroupsBasicOps-823484942 tempest-TestSecurityGroupsBasicOps-823484942-project] [instance: 94257f91-9f2d-4cb4-b7f2-37d9a68758ed] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f5cdc3d5-9524-4220-a7fc-ab5606975fdb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94358) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 21 11:15:33.628507 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-4d2de9d4-2719-42a4-bdbf-9f613aa8ff33 tempest-TestSecurityGroupsBasicOps-823484942 tempest-TestSecurityGroupsBasicOps-823484942-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:15:33.629589 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-4d2de9d4-2719-42a4-bdbf-9f613aa8ff33 tempest-TestSecurityGroupsBasicOps-823484942 tempest-TestSecurityGroupsBasicOps-823484942-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:15:33.687831 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-4d2de9d4-2719-42a4-bdbf-9f613aa8ff33 tempest-TestSecurityGroupsBasicOps-823484942 tempest-TestSecurityGroupsBasicOps-823484942-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:15:33.688288 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-4d2de9d4-2719-42a4-bdbf-9f613aa8ff33 tempest-TestSecurityGroupsBasicOps-823484942 tempest-TestSecurityGroupsBasicOps-823484942-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:15:37.307685 n-d-811414-3 nova-conductor[94357]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6404cb3a-bdc9-481c-93a6-d63501b53d9b] AMQP server on 10.222.0.13:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Apr 21 11:15:38.317279 n-d-811414-3 nova-conductor[94357]: INFO oslo.messaging._drivers.impl_rabbit [-] [6404cb3a-bdc9-481c-93a6-d63501b53d9b] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 59216. Apr 21 11:16:00.082410 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-cf03a36b-6062-4993-9000-baf9f3a57a3f tempest-TestVolumeBootPattern-1683621464 tempest-TestVolumeBootPattern-1683621464-project] Took 0.33 seconds to select destinations for 1 instance(s). {{(pid=94357) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 21 11:16:00.157841 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-cf03a36b-6062-4993-9000-baf9f3a57a3f tempest-TestVolumeBootPattern-1683621464 tempest-TestVolumeBootPattern-1683621464-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:16:00.177255 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-cf03a36b-6062-4993-9000-baf9f3a57a3f tempest-TestVolumeBootPattern-1683621464 tempest-TestVolumeBootPattern-1683621464-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:16:00.269024 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-cf03a36b-6062-4993-9000-baf9f3a57a3f tempest-TestVolumeBootPattern-1683621464 tempest-TestVolumeBootPattern-1683621464-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:16:00.269708 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-cf03a36b-6062-4993-9000-baf9f3a57a3f tempest-TestVolumeBootPattern-1683621464 tempest-TestVolumeBootPattern-1683621464-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:16:00.270727 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-cf03a36b-6062-4993-9000-baf9f3a57a3f tempest-TestVolumeBootPattern-1683621464 tempest-TestVolumeBootPattern-1683621464-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:16:00.271384 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-cf03a36b-6062-4993-9000-baf9f3a57a3f tempest-TestVolumeBootPattern-1683621464 tempest-TestVolumeBootPattern-1683621464-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:16:00.292099 n-d-811414-3 nova-conductor[94357]: DEBUG nova.quota [None req-cf03a36b-6062-4993-9000-baf9f3a57a3f tempest-TestVolumeBootPattern-1683621464 tempest-TestVolumeBootPattern-1683621464-project] Getting quotas for project eb539520fc5e47a8b097c107b50f602c. Resources: {'instances', 'cores', 'ram'} {{(pid=94357) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 21 11:16:00.299991 n-d-811414-3 nova-conductor[94357]: DEBUG nova.quota [None req-cf03a36b-6062-4993-9000-baf9f3a57a3f tempest-TestVolumeBootPattern-1683621464 tempest-TestVolumeBootPattern-1683621464-project] Getting quotas for user 5ccc090867c04164a1429e908a4913cc and project eb539520fc5e47a8b097c107b50f602c. Resources: {'instances', 'cores', 'ram'} {{(pid=94357) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 21 11:16:00.313631 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-cf03a36b-6062-4993-9000-baf9f3a57a3f tempest-TestVolumeBootPattern-1683621464 tempest-TestVolumeBootPattern-1683621464-project] [instance: dd510ce1-505b-4523-8f78-7307dd015cc0] Selected host: n-h1-811414-3; Selected node: n-h1-811414-3; Alternates: [('n-h2-811414-3', 'n-h2-811414-3')] {{(pid=94357) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 21 11:16:00.315866 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-cf03a36b-6062-4993-9000-baf9f3a57a3f tempest-TestVolumeBootPattern-1683621464 tempest-TestVolumeBootPattern-1683621464-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:16:00.316412 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-cf03a36b-6062-4993-9000-baf9f3a57a3f tempest-TestVolumeBootPattern-1683621464 tempest-TestVolumeBootPattern-1683621464-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:16:00.328568 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-cf03a36b-6062-4993-9000-baf9f3a57a3f tempest-TestVolumeBootPattern-1683621464 tempest-TestVolumeBootPattern-1683621464-project] [instance: dd510ce1-505b-4523-8f78-7307dd015cc0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='bdb7c0ba-cd15-4e63-88f8-2dfe387caac4',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=94357) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 21 11:16:00.331578 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-cf03a36b-6062-4993-9000-baf9f3a57a3f tempest-TestVolumeBootPattern-1683621464 tempest-TestVolumeBootPattern-1683621464-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:16:00.332134 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-cf03a36b-6062-4993-9000-baf9f3a57a3f tempest-TestVolumeBootPattern-1683621464 tempest-TestVolumeBootPattern-1683621464-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:16:00.404073 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-cf03a36b-6062-4993-9000-baf9f3a57a3f tempest-TestVolumeBootPattern-1683621464 tempest-TestVolumeBootPattern-1683621464-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:16:00.404646 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-cf03a36b-6062-4993-9000-baf9f3a57a3f tempest-TestVolumeBootPattern-1683621464 tempest-TestVolumeBootPattern-1683621464-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:16:00.866888 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-a3a02657-6234-4462-860e-6bb2f0cdde03 tempest-ServerPasswordTestJSON-581406246 tempest-ServerPasswordTestJSON-581406246-project] Took 0.46 seconds to select destinations for 1 instance(s). {{(pid=94358) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 21 11:16:00.898390 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-a3a02657-6234-4462-860e-6bb2f0cdde03 tempest-ServerPasswordTestJSON-581406246 tempest-ServerPasswordTestJSON-581406246-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:16:00.899040 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-a3a02657-6234-4462-860e-6bb2f0cdde03 tempest-ServerPasswordTestJSON-581406246 tempest-ServerPasswordTestJSON-581406246-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:16:01.013212 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-a3a02657-6234-4462-860e-6bb2f0cdde03 tempest-ServerPasswordTestJSON-581406246 tempest-ServerPasswordTestJSON-581406246-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:16:01.013945 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-a3a02657-6234-4462-860e-6bb2f0cdde03 tempest-ServerPasswordTestJSON-581406246 tempest-ServerPasswordTestJSON-581406246-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:16:01.015724 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-a3a02657-6234-4462-860e-6bb2f0cdde03 tempest-ServerPasswordTestJSON-581406246 tempest-ServerPasswordTestJSON-581406246-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:16:01.016845 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-a3a02657-6234-4462-860e-6bb2f0cdde03 tempest-ServerPasswordTestJSON-581406246 tempest-ServerPasswordTestJSON-581406246-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:16:01.071233 n-d-811414-3 nova-conductor[94358]: DEBUG nova.quota [None req-a3a02657-6234-4462-860e-6bb2f0cdde03 tempest-ServerPasswordTestJSON-581406246 tempest-ServerPasswordTestJSON-581406246-project] Getting quotas for project 2964dbd4af0f407f9e4ec76e60b14510. Resources: {'instances', 'cores', 'ram'} {{(pid=94358) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 21 11:16:01.090371 n-d-811414-3 nova-conductor[94358]: DEBUG nova.quota [None req-a3a02657-6234-4462-860e-6bb2f0cdde03 tempest-ServerPasswordTestJSON-581406246 tempest-ServerPasswordTestJSON-581406246-project] Getting quotas for user 34e02582101a479a97942af41db94026 and project 2964dbd4af0f407f9e4ec76e60b14510. Resources: {'instances', 'cores', 'ram'} {{(pid=94358) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 21 11:16:01.123772 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-a3a02657-6234-4462-860e-6bb2f0cdde03 tempest-ServerPasswordTestJSON-581406246 tempest-ServerPasswordTestJSON-581406246-project] [instance: 0bcca6b8-1cf2-402f-840a-bcb0a3be39a1] Selected host: n-h1-811414-3; Selected node: n-h1-811414-3; Alternates: [('n-h2-811414-3', 'n-h2-811414-3')] {{(pid=94358) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 21 11:16:01.124752 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-a3a02657-6234-4462-860e-6bb2f0cdde03 tempest-ServerPasswordTestJSON-581406246 tempest-ServerPasswordTestJSON-581406246-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:16:01.125152 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-a3a02657-6234-4462-860e-6bb2f0cdde03 tempest-ServerPasswordTestJSON-581406246 tempest-ServerPasswordTestJSON-581406246-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:16:01.146646 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-a3a02657-6234-4462-860e-6bb2f0cdde03 tempest-ServerPasswordTestJSON-581406246 tempest-ServerPasswordTestJSON-581406246-project] [instance: 0bcca6b8-1cf2-402f-840a-bcb0a3be39a1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f5cdc3d5-9524-4220-a7fc-ab5606975fdb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94358) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 21 11:16:01.147884 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-a3a02657-6234-4462-860e-6bb2f0cdde03 tempest-ServerPasswordTestJSON-581406246 tempest-ServerPasswordTestJSON-581406246-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:16:01.148306 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-a3a02657-6234-4462-860e-6bb2f0cdde03 tempest-ServerPasswordTestJSON-581406246 tempest-ServerPasswordTestJSON-581406246-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:16:01.198408 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-a3a02657-6234-4462-860e-6bb2f0cdde03 tempest-ServerPasswordTestJSON-581406246 tempest-ServerPasswordTestJSON-581406246-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:16:01.198819 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-a3a02657-6234-4462-860e-6bb2f0cdde03 tempest-ServerPasswordTestJSON-581406246 tempest-ServerPasswordTestJSON-581406246-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:16:03.184016 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-cc076fae-ddda-43b3-8916-0d2593889845 tempest-TestNetworkAdvancedServerOps-1762921480 tempest-TestNetworkAdvancedServerOps-1762921480-project-admin] Targeting cell 6c99d8ec-fb48-48af-b02b-a629a7c2cb6b(cell1) for conductor method migrate_server {{(pid=94357) wrapper /opt/stack/nova/nova/conductor/manager.py:91}} Apr 21 11:16:03.184583 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-cc076fae-ddda-43b3-8916-0d2593889845 tempest-TestNetworkAdvancedServerOps-1762921480 tempest-TestNetworkAdvancedServerOps-1762921480-project-admin] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:16:03.185033 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-cc076fae-ddda-43b3-8916-0d2593889845 tempest-TestNetworkAdvancedServerOps-1762921480 tempest-TestNetworkAdvancedServerOps-1762921480-project-admin] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:16:03.869921 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.tasks.migrate [None req-cc076fae-ddda-43b3-8916-0d2593889845 tempest-TestNetworkAdvancedServerOps-1762921480 tempest-TestNetworkAdvancedServerOps-1762921480-project-admin] [instance: 17858db6-b7e8-4af7-a6e3-275dc919730f] Restricting to cell 6c99d8ec-fb48-48af-b02b-a629a7c2cb6b(cell1) while migrating {{(pid=94357) _set_requested_destination_cell /opt/stack/nova/nova/conductor/tasks/migrate.py:208}} Apr 21 11:16:04.411891 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.tasks.migrate [None req-cc076fae-ddda-43b3-8916-0d2593889845 tempest-TestNetworkAdvancedServerOps-1762921480 tempest-TestNetworkAdvancedServerOps-1762921480-project-admin] Created allocations for migration c5084a0d-46ba-478f-985a-ae961af147b4 on 6ea3f8b1-0c53-40ba-ba27-f80f78a284a6 {{(pid=94357) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} Apr 21 11:16:04.810658 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.tasks.migrate [None req-cc076fae-ddda-43b3-8916-0d2593889845 tempest-TestNetworkAdvancedServerOps-1762921480 tempest-TestNetworkAdvancedServerOps-1762921480-project-admin] [instance: 17858db6-b7e8-4af7-a6e3-275dc919730f] Calling prep_resize with selected host: n-h1-811414-3; Selected node: n-h1-811414-3; Alternates: [] {{(pid=94357) _execute /opt/stack/nova/nova/conductor/tasks/migrate.py:315}} Apr 21 11:16:18.403509 n-d-811414-3 nova-conductor[94358]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 21 11:16:59.698030 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-a2647215-1190-484e-bf38-9d8ed3ee16a1 tempest-VolumesBackupsTest-697108548 tempest-VolumesBackupsTest-697108548-project] Took 0.41 seconds to select destinations for 1 instance(s). {{(pid=94358) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 21 11:16:59.739489 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-a2647215-1190-484e-bf38-9d8ed3ee16a1 tempest-VolumesBackupsTest-697108548 tempest-VolumesBackupsTest-697108548-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:16:59.740854 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-a2647215-1190-484e-bf38-9d8ed3ee16a1 tempest-VolumesBackupsTest-697108548 tempest-VolumesBackupsTest-697108548-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:16:59.838496 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-a2647215-1190-484e-bf38-9d8ed3ee16a1 tempest-VolumesBackupsTest-697108548 tempest-VolumesBackupsTest-697108548-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:16:59.839139 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-a2647215-1190-484e-bf38-9d8ed3ee16a1 tempest-VolumesBackupsTest-697108548 tempest-VolumesBackupsTest-697108548-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:16:59.840218 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-a2647215-1190-484e-bf38-9d8ed3ee16a1 tempest-VolumesBackupsTest-697108548 tempest-VolumesBackupsTest-697108548-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:16:59.840888 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-a2647215-1190-484e-bf38-9d8ed3ee16a1 tempest-VolumesBackupsTest-697108548 tempest-VolumesBackupsTest-697108548-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:16:59.860201 n-d-811414-3 nova-conductor[94358]: DEBUG nova.quota [None req-a2647215-1190-484e-bf38-9d8ed3ee16a1 tempest-VolumesBackupsTest-697108548 tempest-VolumesBackupsTest-697108548-project] Getting quotas for project ab7d1ecd4709437b872d212f966495fa. Resources: {'instances', 'cores', 'ram'} {{(pid=94358) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 21 11:16:59.866727 n-d-811414-3 nova-conductor[94358]: DEBUG nova.quota [None req-a2647215-1190-484e-bf38-9d8ed3ee16a1 tempest-VolumesBackupsTest-697108548 tempest-VolumesBackupsTest-697108548-project] Getting quotas for user 818f1eb933ac4318b6c73abf37e3d8c5 and project ab7d1ecd4709437b872d212f966495fa. Resources: {'instances', 'cores', 'ram'} {{(pid=94358) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 21 11:16:59.883236 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-a2647215-1190-484e-bf38-9d8ed3ee16a1 tempest-VolumesBackupsTest-697108548 tempest-VolumesBackupsTest-697108548-project] [instance: 8dddfe51-a424-4236-97eb-d860d52adcc8] Selected host: n-h1-811414-3; Selected node: n-h1-811414-3; Alternates: [('n-h2-811414-3', 'n-h2-811414-3')] {{(pid=94358) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 21 11:16:59.884450 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-a2647215-1190-484e-bf38-9d8ed3ee16a1 tempest-VolumesBackupsTest-697108548 tempest-VolumesBackupsTest-697108548-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:16:59.885201 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-a2647215-1190-484e-bf38-9d8ed3ee16a1 tempest-VolumesBackupsTest-697108548 tempest-VolumesBackupsTest-697108548-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:16:59.895585 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-a2647215-1190-484e-bf38-9d8ed3ee16a1 tempest-VolumesBackupsTest-697108548 tempest-VolumesBackupsTest-697108548-project] [instance: 8dddfe51-a424-4236-97eb-d860d52adcc8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f5cdc3d5-9524-4220-a7fc-ab5606975fdb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94358) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 21 11:16:59.902565 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-a2647215-1190-484e-bf38-9d8ed3ee16a1 tempest-VolumesBackupsTest-697108548 tempest-VolumesBackupsTest-697108548-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:16:59.903969 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-a2647215-1190-484e-bf38-9d8ed3ee16a1 tempest-VolumesBackupsTest-697108548 tempest-VolumesBackupsTest-697108548-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:16:59.985727 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-a2647215-1190-484e-bf38-9d8ed3ee16a1 tempest-VolumesBackupsTest-697108548 tempest-VolumesBackupsTest-697108548-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:16:59.986223 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-a2647215-1190-484e-bf38-9d8ed3ee16a1 tempest-VolumesBackupsTest-697108548 tempest-VolumesBackupsTest-697108548-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:17:02.635983 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-a10a5268-f83e-4ccf-a47d-8251976eb5af tempest-AttachVolumeTestJSON-1736363069 tempest-AttachVolumeTestJSON-1736363069-project] Took 0.45 seconds to select destinations for 1 instance(s). {{(pid=94357) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 21 11:17:02.710164 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-a10a5268-f83e-4ccf-a47d-8251976eb5af tempest-AttachVolumeTestJSON-1736363069 tempest-AttachVolumeTestJSON-1736363069-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:17:02.710703 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-a10a5268-f83e-4ccf-a47d-8251976eb5af tempest-AttachVolumeTestJSON-1736363069 tempest-AttachVolumeTestJSON-1736363069-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:17:02.794904 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-a10a5268-f83e-4ccf-a47d-8251976eb5af tempest-AttachVolumeTestJSON-1736363069 tempest-AttachVolumeTestJSON-1736363069-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:17:02.795847 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-a10a5268-f83e-4ccf-a47d-8251976eb5af tempest-AttachVolumeTestJSON-1736363069 tempest-AttachVolumeTestJSON-1736363069-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:17:02.796755 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-a10a5268-f83e-4ccf-a47d-8251976eb5af tempest-AttachVolumeTestJSON-1736363069 tempest-AttachVolumeTestJSON-1736363069-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:17:02.797296 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-a10a5268-f83e-4ccf-a47d-8251976eb5af tempest-AttachVolumeTestJSON-1736363069 tempest-AttachVolumeTestJSON-1736363069-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:17:02.819785 n-d-811414-3 nova-conductor[94357]: DEBUG nova.quota [None req-a10a5268-f83e-4ccf-a47d-8251976eb5af tempest-AttachVolumeTestJSON-1736363069 tempest-AttachVolumeTestJSON-1736363069-project] Getting quotas for project c9814ccacb9a4e9db5715a282eaf47eb. Resources: {'instances', 'cores', 'ram'} {{(pid=94357) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 21 11:17:02.824770 n-d-811414-3 nova-conductor[94357]: DEBUG nova.quota [None req-a10a5268-f83e-4ccf-a47d-8251976eb5af tempest-AttachVolumeTestJSON-1736363069 tempest-AttachVolumeTestJSON-1736363069-project] Getting quotas for user 776af60a254c4fab864253ff320dfa81 and project c9814ccacb9a4e9db5715a282eaf47eb. Resources: {'instances', 'cores', 'ram'} {{(pid=94357) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 21 11:17:02.842873 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-a10a5268-f83e-4ccf-a47d-8251976eb5af tempest-AttachVolumeTestJSON-1736363069 tempest-AttachVolumeTestJSON-1736363069-project] [instance: 966f19ed-aba5-41e8-8650-5d5036a0163c] Selected host: n-h2-811414-3; Selected node: n-h2-811414-3; Alternates: [('n-h1-811414-3', 'n-h1-811414-3')] {{(pid=94357) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 21 11:17:02.844446 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-a10a5268-f83e-4ccf-a47d-8251976eb5af tempest-AttachVolumeTestJSON-1736363069 tempest-AttachVolumeTestJSON-1736363069-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:17:02.845009 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-a10a5268-f83e-4ccf-a47d-8251976eb5af tempest-AttachVolumeTestJSON-1736363069 tempest-AttachVolumeTestJSON-1736363069-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:17:02.856027 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-a10a5268-f83e-4ccf-a47d-8251976eb5af tempest-AttachVolumeTestJSON-1736363069 tempest-AttachVolumeTestJSON-1736363069-project] [instance: 966f19ed-aba5-41e8-8650-5d5036a0163c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f5cdc3d5-9524-4220-a7fc-ab5606975fdb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94357) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 21 11:17:02.859303 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-a10a5268-f83e-4ccf-a47d-8251976eb5af tempest-AttachVolumeTestJSON-1736363069 tempest-AttachVolumeTestJSON-1736363069-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:17:02.860123 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-a10a5268-f83e-4ccf-a47d-8251976eb5af tempest-AttachVolumeTestJSON-1736363069 tempest-AttachVolumeTestJSON-1736363069-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:17:02.913169 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-a10a5268-f83e-4ccf-a47d-8251976eb5af tempest-AttachVolumeTestJSON-1736363069 tempest-AttachVolumeTestJSON-1736363069-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:17:02.913601 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-a10a5268-f83e-4ccf-a47d-8251976eb5af tempest-AttachVolumeTestJSON-1736363069 tempest-AttachVolumeTestJSON-1736363069-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:17:11.469722 n-d-811414-3 nova-conductor[94357]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 21 11:17:18.566370 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-eea68e56-767f-4d56-ab59-b185387b58a7 tempest-TestVolumeBootPattern-1683621464 tempest-TestVolumeBootPattern-1683621464-project] Took 0.27 seconds to select destinations for 1 instance(s). {{(pid=94358) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 21 11:17:18.619383 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-eea68e56-767f-4d56-ab59-b185387b58a7 tempest-TestVolumeBootPattern-1683621464 tempest-TestVolumeBootPattern-1683621464-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:17:18.619783 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-eea68e56-767f-4d56-ab59-b185387b58a7 tempest-TestVolumeBootPattern-1683621464 tempest-TestVolumeBootPattern-1683621464-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:17:18.669520 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-eea68e56-767f-4d56-ab59-b185387b58a7 tempest-TestVolumeBootPattern-1683621464 tempest-TestVolumeBootPattern-1683621464-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:17:18.669936 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-eea68e56-767f-4d56-ab59-b185387b58a7 tempest-TestVolumeBootPattern-1683621464 tempest-TestVolumeBootPattern-1683621464-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:17:18.671054 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-eea68e56-767f-4d56-ab59-b185387b58a7 tempest-TestVolumeBootPattern-1683621464 tempest-TestVolumeBootPattern-1683621464-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:17:18.671218 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-eea68e56-767f-4d56-ab59-b185387b58a7 tempest-TestVolumeBootPattern-1683621464 tempest-TestVolumeBootPattern-1683621464-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:17:18.705563 n-d-811414-3 nova-conductor[94358]: DEBUG nova.quota [None req-eea68e56-767f-4d56-ab59-b185387b58a7 tempest-TestVolumeBootPattern-1683621464 tempest-TestVolumeBootPattern-1683621464-project] Getting quotas for project eb539520fc5e47a8b097c107b50f602c. Resources: {'instances', 'cores', 'ram'} {{(pid=94358) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 21 11:17:18.720269 n-d-811414-3 nova-conductor[94358]: DEBUG nova.quota [None req-eea68e56-767f-4d56-ab59-b185387b58a7 tempest-TestVolumeBootPattern-1683621464 tempest-TestVolumeBootPattern-1683621464-project] Getting quotas for user 5ccc090867c04164a1429e908a4913cc and project eb539520fc5e47a8b097c107b50f602c. Resources: {'instances', 'cores', 'ram'} {{(pid=94358) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 21 11:17:18.738082 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-eea68e56-767f-4d56-ab59-b185387b58a7 tempest-TestVolumeBootPattern-1683621464 tempest-TestVolumeBootPattern-1683621464-project] [instance: b86d0bad-31af-4483-b8e8-141bb91af3d5] Selected host: n-h1-811414-3; Selected node: n-h1-811414-3; Alternates: [('n-h2-811414-3', 'n-h2-811414-3')] {{(pid=94358) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 21 11:17:18.740559 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-eea68e56-767f-4d56-ab59-b185387b58a7 tempest-TestVolumeBootPattern-1683621464 tempest-TestVolumeBootPattern-1683621464-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:17:18.740797 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-eea68e56-767f-4d56-ab59-b185387b58a7 tempest-TestVolumeBootPattern-1683621464 tempest-TestVolumeBootPattern-1683621464-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:17:18.753971 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-eea68e56-767f-4d56-ab59-b185387b58a7 tempest-TestVolumeBootPattern-1683621464 tempest-TestVolumeBootPattern-1683621464-project] [instance: b86d0bad-31af-4483-b8e8-141bb91af3d5] block_device_mapping [BlockDeviceMapping(attachment_id=c1dc0244-0336-441a-a717-729d8a2420a5,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ac5c53b3-7147-46ff-a58d-78337e616e97',volume_size=1,volume_type=None)] {{(pid=94358) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 21 11:17:18.757767 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-eea68e56-767f-4d56-ab59-b185387b58a7 tempest-TestVolumeBootPattern-1683621464 tempest-TestVolumeBootPattern-1683621464-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:17:18.758573 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-eea68e56-767f-4d56-ab59-b185387b58a7 tempest-TestVolumeBootPattern-1683621464 tempest-TestVolumeBootPattern-1683621464-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:17:18.792925 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-eea68e56-767f-4d56-ab59-b185387b58a7 tempest-TestVolumeBootPattern-1683621464 tempest-TestVolumeBootPattern-1683621464-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:17:18.794086 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-eea68e56-767f-4d56-ab59-b185387b58a7 tempest-TestVolumeBootPattern-1683621464 tempest-TestVolumeBootPattern-1683621464-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:17:42.045711 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-818d8cef-b2e9-4c50-b045-af9dcb15dc0e tempest-TestNetworkAdvancedServerOps-151663419 tempest-TestNetworkAdvancedServerOps-151663419-project] Took 0.29 seconds to select destinations for 1 instance(s). {{(pid=94357) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 21 11:17:42.077404 n-d-811414-3 nova-conductor[94358]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f60095b5-b68f-459e-af9a-3776dcd48c13] AMQP server on 10.222.0.13:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Apr 21 11:17:42.136440 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-818d8cef-b2e9-4c50-b045-af9dcb15dc0e tempest-TestNetworkAdvancedServerOps-151663419 tempest-TestNetworkAdvancedServerOps-151663419-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:17:42.136996 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-818d8cef-b2e9-4c50-b045-af9dcb15dc0e tempest-TestNetworkAdvancedServerOps-151663419 tempest-TestNetworkAdvancedServerOps-151663419-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:17:42.215458 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-818d8cef-b2e9-4c50-b045-af9dcb15dc0e tempest-TestNetworkAdvancedServerOps-151663419 tempest-TestNetworkAdvancedServerOps-151663419-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:17:42.215936 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-818d8cef-b2e9-4c50-b045-af9dcb15dc0e tempest-TestNetworkAdvancedServerOps-151663419 tempest-TestNetworkAdvancedServerOps-151663419-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:17:42.216823 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-818d8cef-b2e9-4c50-b045-af9dcb15dc0e tempest-TestNetworkAdvancedServerOps-151663419 tempest-TestNetworkAdvancedServerOps-151663419-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:17:42.217280 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-818d8cef-b2e9-4c50-b045-af9dcb15dc0e tempest-TestNetworkAdvancedServerOps-151663419 tempest-TestNetworkAdvancedServerOps-151663419-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:17:42.235309 n-d-811414-3 nova-conductor[94357]: DEBUG nova.quota [None req-818d8cef-b2e9-4c50-b045-af9dcb15dc0e tempest-TestNetworkAdvancedServerOps-151663419 tempest-TestNetworkAdvancedServerOps-151663419-project] Getting quotas for project 2cd24407ec634f049086868ad62d3916. Resources: {'instances', 'cores', 'ram'} {{(pid=94357) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 21 11:17:42.245704 n-d-811414-3 nova-conductor[94357]: DEBUG nova.quota [None req-818d8cef-b2e9-4c50-b045-af9dcb15dc0e tempest-TestNetworkAdvancedServerOps-151663419 tempest-TestNetworkAdvancedServerOps-151663419-project] Getting quotas for user 7353f8631717442ab4e8c6704e3b3708 and project 2cd24407ec634f049086868ad62d3916. Resources: {'instances', 'cores', 'ram'} {{(pid=94357) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 21 11:17:42.288964 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-818d8cef-b2e9-4c50-b045-af9dcb15dc0e tempest-TestNetworkAdvancedServerOps-151663419 tempest-TestNetworkAdvancedServerOps-151663419-project] [instance: ca1b3e2a-da99-4d2d-9a9b-e750f1448266] Selected host: n-h2-811414-3; Selected node: n-h2-811414-3; Alternates: [('n-h1-811414-3', 'n-h1-811414-3')] {{(pid=94357) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 21 11:17:42.289917 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-818d8cef-b2e9-4c50-b045-af9dcb15dc0e tempest-TestNetworkAdvancedServerOps-151663419 tempest-TestNetworkAdvancedServerOps-151663419-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:17:42.290313 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-818d8cef-b2e9-4c50-b045-af9dcb15dc0e tempest-TestNetworkAdvancedServerOps-151663419 tempest-TestNetworkAdvancedServerOps-151663419-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:17:42.312210 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-818d8cef-b2e9-4c50-b045-af9dcb15dc0e tempest-TestNetworkAdvancedServerOps-151663419 tempest-TestNetworkAdvancedServerOps-151663419-project] [instance: ca1b3e2a-da99-4d2d-9a9b-e750f1448266] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f5cdc3d5-9524-4220-a7fc-ab5606975fdb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94357) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 21 11:17:42.315600 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-818d8cef-b2e9-4c50-b045-af9dcb15dc0e tempest-TestNetworkAdvancedServerOps-151663419 tempest-TestNetworkAdvancedServerOps-151663419-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:17:42.316004 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-818d8cef-b2e9-4c50-b045-af9dcb15dc0e tempest-TestNetworkAdvancedServerOps-151663419 tempest-TestNetworkAdvancedServerOps-151663419-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:17:42.395487 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-818d8cef-b2e9-4c50-b045-af9dcb15dc0e tempest-TestNetworkAdvancedServerOps-151663419 tempest-TestNetworkAdvancedServerOps-151663419-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:17:42.395900 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-818d8cef-b2e9-4c50-b045-af9dcb15dc0e tempest-TestNetworkAdvancedServerOps-151663419 tempest-TestNetworkAdvancedServerOps-151663419-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:17:43.089444 n-d-811414-3 nova-conductor[94358]: INFO oslo.messaging._drivers.impl_rabbit [-] [f60095b5-b68f-459e-af9a-3776dcd48c13] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 33870. Apr 21 11:17:43.807590 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-a8b058bd-a8be-452a-b05c-308d7a4e13be tempest-TestVolumeBootPattern-1683621464 tempest-TestVolumeBootPattern-1683621464-project] Took 0.38 seconds to select destinations for 1 instance(s). {{(pid=94358) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 21 11:17:43.873270 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-a8b058bd-a8be-452a-b05c-308d7a4e13be tempest-TestVolumeBootPattern-1683621464 tempest-TestVolumeBootPattern-1683621464-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:17:43.873270 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-a8b058bd-a8be-452a-b05c-308d7a4e13be tempest-TestVolumeBootPattern-1683621464 tempest-TestVolumeBootPattern-1683621464-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:17:43.978251 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-a8b058bd-a8be-452a-b05c-308d7a4e13be tempest-TestVolumeBootPattern-1683621464 tempest-TestVolumeBootPattern-1683621464-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:17:43.978878 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-a8b058bd-a8be-452a-b05c-308d7a4e13be tempest-TestVolumeBootPattern-1683621464 tempest-TestVolumeBootPattern-1683621464-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:17:43.979676 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-a8b058bd-a8be-452a-b05c-308d7a4e13be tempest-TestVolumeBootPattern-1683621464 tempest-TestVolumeBootPattern-1683621464-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:17:43.980416 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-a8b058bd-a8be-452a-b05c-308d7a4e13be tempest-TestVolumeBootPattern-1683621464 tempest-TestVolumeBootPattern-1683621464-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:17:43.999315 n-d-811414-3 nova-conductor[94358]: DEBUG nova.quota [None req-a8b058bd-a8be-452a-b05c-308d7a4e13be tempest-TestVolumeBootPattern-1683621464 tempest-TestVolumeBootPattern-1683621464-project] Getting quotas for project eb539520fc5e47a8b097c107b50f602c. Resources: {'instances', 'cores', 'ram'} {{(pid=94358) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 21 11:17:44.004504 n-d-811414-3 nova-conductor[94358]: DEBUG nova.quota [None req-a8b058bd-a8be-452a-b05c-308d7a4e13be tempest-TestVolumeBootPattern-1683621464 tempest-TestVolumeBootPattern-1683621464-project] Getting quotas for user 5ccc090867c04164a1429e908a4913cc and project eb539520fc5e47a8b097c107b50f602c. Resources: {'instances', 'cores', 'ram'} {{(pid=94358) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 21 11:17:44.024340 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-a8b058bd-a8be-452a-b05c-308d7a4e13be tempest-TestVolumeBootPattern-1683621464 tempest-TestVolumeBootPattern-1683621464-project] [instance: 44385458-c0a8-48a1-8145-0981a4140857] Selected host: n-h1-811414-3; Selected node: n-h1-811414-3; Alternates: [('n-h2-811414-3', 'n-h2-811414-3')] {{(pid=94358) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 21 11:17:44.025886 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-a8b058bd-a8be-452a-b05c-308d7a4e13be tempest-TestVolumeBootPattern-1683621464 tempest-TestVolumeBootPattern-1683621464-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:17:44.026302 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-a8b058bd-a8be-452a-b05c-308d7a4e13be tempest-TestVolumeBootPattern-1683621464 tempest-TestVolumeBootPattern-1683621464-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:17:44.034812 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-a8b058bd-a8be-452a-b05c-308d7a4e13be tempest-TestVolumeBootPattern-1683621464 tempest-TestVolumeBootPattern-1683621464-project] [instance: 44385458-c0a8-48a1-8145-0981a4140857] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name='/dev/sda',device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='3f6bd425-c6b4-431f-aa47-c958ceb0a42b',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=94358) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 21 11:17:44.037438 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-a8b058bd-a8be-452a-b05c-308d7a4e13be tempest-TestVolumeBootPattern-1683621464 tempest-TestVolumeBootPattern-1683621464-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:17:44.048488 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-a8b058bd-a8be-452a-b05c-308d7a4e13be tempest-TestVolumeBootPattern-1683621464 tempest-TestVolumeBootPattern-1683621464-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:17:44.114192 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-a8b058bd-a8be-452a-b05c-308d7a4e13be tempest-TestVolumeBootPattern-1683621464 tempest-TestVolumeBootPattern-1683621464-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:17:44.114817 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-a8b058bd-a8be-452a-b05c-308d7a4e13be tempest-TestVolumeBootPattern-1683621464 tempest-TestVolumeBootPattern-1683621464-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:18:33.730473 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-0518d84c-f43e-481c-84f4-0d0019c09eaf tempest-TestNetworkAdvancedServerOps-1762921480 tempest-TestNetworkAdvancedServerOps-1762921480-project-admin] Targeting cell 6c99d8ec-fb48-48af-b02b-a629a7c2cb6b(cell1) for conductor method migrate_server {{(pid=94357) wrapper /opt/stack/nova/nova/conductor/manager.py:91}} Apr 21 11:18:33.730954 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-0518d84c-f43e-481c-84f4-0d0019c09eaf tempest-TestNetworkAdvancedServerOps-1762921480 tempest-TestNetworkAdvancedServerOps-1762921480-project-admin] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:18:33.731205 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-0518d84c-f43e-481c-84f4-0d0019c09eaf tempest-TestNetworkAdvancedServerOps-1762921480 tempest-TestNetworkAdvancedServerOps-1762921480-project-admin] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:18:34.175299 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.tasks.migrate [None req-0518d84c-f43e-481c-84f4-0d0019c09eaf tempest-TestNetworkAdvancedServerOps-1762921480 tempest-TestNetworkAdvancedServerOps-1762921480-project-admin] [instance: ca1b3e2a-da99-4d2d-9a9b-e750f1448266] Restricting to cell 6c99d8ec-fb48-48af-b02b-a629a7c2cb6b(cell1) while migrating {{(pid=94357) _set_requested_destination_cell /opt/stack/nova/nova/conductor/tasks/migrate.py:208}} Apr 21 11:18:34.683918 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.tasks.migrate [None req-0518d84c-f43e-481c-84f4-0d0019c09eaf tempest-TestNetworkAdvancedServerOps-1762921480 tempest-TestNetworkAdvancedServerOps-1762921480-project-admin] Created allocations for migration de588199-5e1b-48e5-a356-c167f95a42dd on 6ea3f8b1-0c53-40ba-ba27-f80f78a284a6 {{(pid=94357) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} Apr 21 11:18:35.038584 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.tasks.migrate [None req-0518d84c-f43e-481c-84f4-0d0019c09eaf tempest-TestNetworkAdvancedServerOps-1762921480 tempest-TestNetworkAdvancedServerOps-1762921480-project-admin] [instance: ca1b3e2a-da99-4d2d-9a9b-e750f1448266] Calling prep_resize with selected host: n-h1-811414-3; Selected node: n-h1-811414-3; Alternates: [] {{(pid=94357) _execute /opt/stack/nova/nova/conductor/tasks/migrate.py:315}} Apr 21 11:18:38.317590 n-d-811414-3 nova-conductor[94357]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6404cb3a-bdc9-481c-93a6-d63501b53d9b] AMQP server on 10.222.0.13:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Apr 21 11:18:39.326948 n-d-811414-3 nova-conductor[94357]: INFO oslo.messaging._drivers.impl_rabbit [-] [6404cb3a-bdc9-481c-93a6-d63501b53d9b] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 35822. Apr 21 11:19:08.353962 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-c7ad99d3-695b-48ae-88d6-eddddd82e067 tempest-TestVolumeBootPattern-1683621464 tempest-TestVolumeBootPattern-1683621464-project] Took 0.39 seconds to select destinations for 1 instance(s). {{(pid=94358) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 21 11:19:08.421492 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-c7ad99d3-695b-48ae-88d6-eddddd82e067 tempest-TestVolumeBootPattern-1683621464 tempest-TestVolumeBootPattern-1683621464-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:19:08.422258 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-c7ad99d3-695b-48ae-88d6-eddddd82e067 tempest-TestVolumeBootPattern-1683621464 tempest-TestVolumeBootPattern-1683621464-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:19:08.506040 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-c7ad99d3-695b-48ae-88d6-eddddd82e067 tempest-TestVolumeBootPattern-1683621464 tempest-TestVolumeBootPattern-1683621464-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:19:08.506745 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-c7ad99d3-695b-48ae-88d6-eddddd82e067 tempest-TestVolumeBootPattern-1683621464 tempest-TestVolumeBootPattern-1683621464-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:19:08.509364 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-c7ad99d3-695b-48ae-88d6-eddddd82e067 tempest-TestVolumeBootPattern-1683621464 tempest-TestVolumeBootPattern-1683621464-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:19:08.509991 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-c7ad99d3-695b-48ae-88d6-eddddd82e067 tempest-TestVolumeBootPattern-1683621464 tempest-TestVolumeBootPattern-1683621464-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:19:08.533530 n-d-811414-3 nova-conductor[94358]: DEBUG nova.quota [None req-c7ad99d3-695b-48ae-88d6-eddddd82e067 tempest-TestVolumeBootPattern-1683621464 tempest-TestVolumeBootPattern-1683621464-project] Getting quotas for project eb539520fc5e47a8b097c107b50f602c. Resources: {'instances', 'cores', 'ram'} {{(pid=94358) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 21 11:19:08.543032 n-d-811414-3 nova-conductor[94358]: DEBUG nova.quota [None req-c7ad99d3-695b-48ae-88d6-eddddd82e067 tempest-TestVolumeBootPattern-1683621464 tempest-TestVolumeBootPattern-1683621464-project] Getting quotas for user 5ccc090867c04164a1429e908a4913cc and project eb539520fc5e47a8b097c107b50f602c. Resources: {'instances', 'cores', 'ram'} {{(pid=94358) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 21 11:19:08.574339 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-c7ad99d3-695b-48ae-88d6-eddddd82e067 tempest-TestVolumeBootPattern-1683621464 tempest-TestVolumeBootPattern-1683621464-project] [instance: b445bd18-d950-45b6-84fb-3ff653986a2a] Selected host: n-h1-811414-3; Selected node: n-h1-811414-3; Alternates: [('n-h2-811414-3', 'n-h2-811414-3')] {{(pid=94358) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 21 11:19:08.577361 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-c7ad99d3-695b-48ae-88d6-eddddd82e067 tempest-TestVolumeBootPattern-1683621464 tempest-TestVolumeBootPattern-1683621464-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:19:08.577973 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-c7ad99d3-695b-48ae-88d6-eddddd82e067 tempest-TestVolumeBootPattern-1683621464 tempest-TestVolumeBootPattern-1683621464-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:19:08.603634 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-c7ad99d3-695b-48ae-88d6-eddddd82e067 tempest-TestVolumeBootPattern-1683621464 tempest-TestVolumeBootPattern-1683621464-project] [instance: b445bd18-d950-45b6-84fb-3ff653986a2a] block_device_mapping [BlockDeviceMapping(attachment_id=1958d379-9bb4-4468-ac60-f3cdc19cd2e0,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='4cf0cf18-42f7-44cf-affb-c4fdd40d358c',volume_size=1,volume_type=None)] {{(pid=94358) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 21 11:19:08.607312 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-c7ad99d3-695b-48ae-88d6-eddddd82e067 tempest-TestVolumeBootPattern-1683621464 tempest-TestVolumeBootPattern-1683621464-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:19:08.609334 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-c7ad99d3-695b-48ae-88d6-eddddd82e067 tempest-TestVolumeBootPattern-1683621464 tempest-TestVolumeBootPattern-1683621464-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:19:08.674157 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-c7ad99d3-695b-48ae-88d6-eddddd82e067 tempest-TestVolumeBootPattern-1683621464 tempest-TestVolumeBootPattern-1683621464-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:19:08.674734 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-c7ad99d3-695b-48ae-88d6-eddddd82e067 tempest-TestVolumeBootPattern-1683621464 tempest-TestVolumeBootPattern-1683621464-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:19:38.411672 n-d-811414-3 nova-conductor[94358]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 21 11:19:42.861231 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-dfab1ea6-57d7-4217-883e-62248af9294d tempest-TestServerMultinode-1634907962 tempest-TestServerMultinode-1634907962-project-admin] Took 0.25 seconds to select destinations for 1 instance(s). {{(pid=94357) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 21 11:19:42.886450 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-dfab1ea6-57d7-4217-883e-62248af9294d tempest-TestServerMultinode-1634907962 tempest-TestServerMultinode-1634907962-project-admin] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:19:42.886953 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-dfab1ea6-57d7-4217-883e-62248af9294d tempest-TestServerMultinode-1634907962 tempest-TestServerMultinode-1634907962-project-admin] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:19:42.941556 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-dfab1ea6-57d7-4217-883e-62248af9294d tempest-TestServerMultinode-1634907962 tempest-TestServerMultinode-1634907962-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:19:42.942283 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-dfab1ea6-57d7-4217-883e-62248af9294d tempest-TestServerMultinode-1634907962 tempest-TestServerMultinode-1634907962-project-admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:19:42.943054 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-dfab1ea6-57d7-4217-883e-62248af9294d tempest-TestServerMultinode-1634907962 tempest-TestServerMultinode-1634907962-project-admin] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:19:42.943613 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-dfab1ea6-57d7-4217-883e-62248af9294d tempest-TestServerMultinode-1634907962 tempest-TestServerMultinode-1634907962-project-admin] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:19:42.960265 n-d-811414-3 nova-conductor[94357]: DEBUG nova.quota [None req-dfab1ea6-57d7-4217-883e-62248af9294d tempest-TestServerMultinode-1634907962 tempest-TestServerMultinode-1634907962-project-admin] Getting quotas for project 2c946175fb384704975e3fcc2b510374. Resources: {'instances', 'cores', 'ram'} {{(pid=94357) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 21 11:19:42.965146 n-d-811414-3 nova-conductor[94357]: DEBUG nova.quota [None req-dfab1ea6-57d7-4217-883e-62248af9294d tempest-TestServerMultinode-1634907962 tempest-TestServerMultinode-1634907962-project-admin] Getting quotas for user 271190dc5d9c43129eb3363a9b9bb33f and project 2c946175fb384704975e3fcc2b510374. Resources: {'instances', 'cores', 'ram'} {{(pid=94357) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 21 11:19:42.975947 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-dfab1ea6-57d7-4217-883e-62248af9294d tempest-TestServerMultinode-1634907962 tempest-TestServerMultinode-1634907962-project-admin] [instance: 6e0d3df7-8845-48e0-8183-50844ef9d157] Selected host: n-h1-811414-3; Selected node: n-h1-811414-3; Alternates: [] {{(pid=94357) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 21 11:19:42.976411 n-d-811414-3 nova-conductor[94357]: DEBUG nova.scheduler.utils [None req-dfab1ea6-57d7-4217-883e-62248af9294d tempest-TestServerMultinode-1634907962 tempest-TestServerMultinode-1634907962-project-admin] Re-scheduling is disabled due to forcing a host (['n-h1-811414-3']) and/or node ([]) {{(pid=94357) populate_retry /opt/stack/nova/nova/scheduler/utils.py:951}} Apr 21 11:19:42.977176 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-dfab1ea6-57d7-4217-883e-62248af9294d tempest-TestServerMultinode-1634907962 tempest-TestServerMultinode-1634907962-project-admin] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:19:42.977563 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-dfab1ea6-57d7-4217-883e-62248af9294d tempest-TestServerMultinode-1634907962 tempest-TestServerMultinode-1634907962-project-admin] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:19:42.987515 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-dfab1ea6-57d7-4217-883e-62248af9294d tempest-TestServerMultinode-1634907962 tempest-TestServerMultinode-1634907962-project-admin] [instance: 6e0d3df7-8845-48e0-8183-50844ef9d157] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f5cdc3d5-9524-4220-a7fc-ab5606975fdb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94357) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 21 11:19:42.988955 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-dfab1ea6-57d7-4217-883e-62248af9294d tempest-TestServerMultinode-1634907962 tempest-TestServerMultinode-1634907962-project-admin] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:19:42.989419 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-dfab1ea6-57d7-4217-883e-62248af9294d tempest-TestServerMultinode-1634907962 tempest-TestServerMultinode-1634907962-project-admin] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:19:43.019205 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-dfab1ea6-57d7-4217-883e-62248af9294d tempest-TestServerMultinode-1634907962 tempest-TestServerMultinode-1634907962-project-admin] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:19:43.019586 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-dfab1ea6-57d7-4217-883e-62248af9294d tempest-TestServerMultinode-1634907962 tempest-TestServerMultinode-1634907962-project-admin] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:19:58.722370 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-bda569c4-7c8b-46d3-95e7-749b2cd029db tempest-TestServerMultinode-1634907962 tempest-TestServerMultinode-1634907962-project-admin] Took 0.48 seconds to select destinations for 1 instance(s). {{(pid=94358) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 21 11:19:58.786711 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-bda569c4-7c8b-46d3-95e7-749b2cd029db tempest-TestServerMultinode-1634907962 tempest-TestServerMultinode-1634907962-project-admin] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:19:58.787122 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-bda569c4-7c8b-46d3-95e7-749b2cd029db tempest-TestServerMultinode-1634907962 tempest-TestServerMultinode-1634907962-project-admin] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:19:58.886737 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-bda569c4-7c8b-46d3-95e7-749b2cd029db tempest-TestServerMultinode-1634907962 tempest-TestServerMultinode-1634907962-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:19:58.887296 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-bda569c4-7c8b-46d3-95e7-749b2cd029db tempest-TestServerMultinode-1634907962 tempest-TestServerMultinode-1634907962-project-admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:19:58.888081 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-bda569c4-7c8b-46d3-95e7-749b2cd029db tempest-TestServerMultinode-1634907962 tempest-TestServerMultinode-1634907962-project-admin] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:19:58.888927 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-bda569c4-7c8b-46d3-95e7-749b2cd029db tempest-TestServerMultinode-1634907962 tempest-TestServerMultinode-1634907962-project-admin] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:19:58.913438 n-d-811414-3 nova-conductor[94358]: DEBUG nova.quota [None req-bda569c4-7c8b-46d3-95e7-749b2cd029db tempest-TestServerMultinode-1634907962 tempest-TestServerMultinode-1634907962-project-admin] Getting quotas for project 2c946175fb384704975e3fcc2b510374. Resources: {'instances', 'cores', 'ram'} {{(pid=94358) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 21 11:19:58.919665 n-d-811414-3 nova-conductor[94358]: DEBUG nova.quota [None req-bda569c4-7c8b-46d3-95e7-749b2cd029db tempest-TestServerMultinode-1634907962 tempest-TestServerMultinode-1634907962-project-admin] Getting quotas for user 271190dc5d9c43129eb3363a9b9bb33f and project 2c946175fb384704975e3fcc2b510374. Resources: {'instances', 'cores', 'ram'} {{(pid=94358) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 21 11:19:58.935793 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-bda569c4-7c8b-46d3-95e7-749b2cd029db tempest-TestServerMultinode-1634907962 tempest-TestServerMultinode-1634907962-project-admin] [instance: 7679964d-dc55-457d-81d0-b4ea22a97fc9] Selected host: n-h2-811414-3; Selected node: n-h2-811414-3; Alternates: [] {{(pid=94358) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 21 11:19:58.935793 n-d-811414-3 nova-conductor[94358]: DEBUG nova.scheduler.utils [None req-bda569c4-7c8b-46d3-95e7-749b2cd029db tempest-TestServerMultinode-1634907962 tempest-TestServerMultinode-1634907962-project-admin] Re-scheduling is disabled due to forcing a host (['n-h2-811414-3']) and/or node ([]) {{(pid=94358) populate_retry /opt/stack/nova/nova/scheduler/utils.py:951}} Apr 21 11:19:58.935793 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-bda569c4-7c8b-46d3-95e7-749b2cd029db tempest-TestServerMultinode-1634907962 tempest-TestServerMultinode-1634907962-project-admin] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:19:58.935793 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-bda569c4-7c8b-46d3-95e7-749b2cd029db tempest-TestServerMultinode-1634907962 tempest-TestServerMultinode-1634907962-project-admin] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:19:58.996012 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-bda569c4-7c8b-46d3-95e7-749b2cd029db tempest-TestServerMultinode-1634907962 tempest-TestServerMultinode-1634907962-project-admin] [instance: 7679964d-dc55-457d-81d0-b4ea22a97fc9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f5cdc3d5-9524-4220-a7fc-ab5606975fdb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94358) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 21 11:19:58.998608 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-bda569c4-7c8b-46d3-95e7-749b2cd029db tempest-TestServerMultinode-1634907962 tempest-TestServerMultinode-1634907962-project-admin] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:19:59.000552 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-bda569c4-7c8b-46d3-95e7-749b2cd029db tempest-TestServerMultinode-1634907962 tempest-TestServerMultinode-1634907962-project-admin] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:19:59.073207 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-bda569c4-7c8b-46d3-95e7-749b2cd029db tempest-TestServerMultinode-1634907962 tempest-TestServerMultinode-1634907962-project-admin] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:19:59.073398 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-bda569c4-7c8b-46d3-95e7-749b2cd029db tempest-TestServerMultinode-1634907962 tempest-TestServerMultinode-1634907962-project-admin] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:20:07.191208 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-7a9014c1-dcfd-4116-9868-25c50f131a99 tempest-AttachVolumeTestJSON-1736363069 tempest-AttachVolumeTestJSON-1736363069-project] Took 0.55 seconds to select destinations for 1 instance(s). {{(pid=94357) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 21 11:20:07.230065 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-7a9014c1-dcfd-4116-9868-25c50f131a99 tempest-AttachVolumeTestJSON-1736363069 tempest-AttachVolumeTestJSON-1736363069-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:20:07.230581 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-7a9014c1-dcfd-4116-9868-25c50f131a99 tempest-AttachVolumeTestJSON-1736363069 tempest-AttachVolumeTestJSON-1736363069-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:20:07.310559 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-7a9014c1-dcfd-4116-9868-25c50f131a99 tempest-AttachVolumeTestJSON-1736363069 tempest-AttachVolumeTestJSON-1736363069-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:20:07.310876 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-7a9014c1-dcfd-4116-9868-25c50f131a99 tempest-AttachVolumeTestJSON-1736363069 tempest-AttachVolumeTestJSON-1736363069-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:20:07.311617 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-7a9014c1-dcfd-4116-9868-25c50f131a99 tempest-AttachVolumeTestJSON-1736363069 tempest-AttachVolumeTestJSON-1736363069-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:20:07.311993 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-7a9014c1-dcfd-4116-9868-25c50f131a99 tempest-AttachVolumeTestJSON-1736363069 tempest-AttachVolumeTestJSON-1736363069-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:20:07.337800 n-d-811414-3 nova-conductor[94357]: DEBUG nova.quota [None req-7a9014c1-dcfd-4116-9868-25c50f131a99 tempest-AttachVolumeTestJSON-1736363069 tempest-AttachVolumeTestJSON-1736363069-project] Getting quotas for project c9814ccacb9a4e9db5715a282eaf47eb. Resources: {'instances', 'cores', 'ram'} {{(pid=94357) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 21 11:20:07.337800 n-d-811414-3 nova-conductor[94357]: DEBUG nova.quota [None req-7a9014c1-dcfd-4116-9868-25c50f131a99 tempest-AttachVolumeTestJSON-1736363069 tempest-AttachVolumeTestJSON-1736363069-project] Getting quotas for user 776af60a254c4fab864253ff320dfa81 and project c9814ccacb9a4e9db5715a282eaf47eb. Resources: {'instances', 'cores', 'ram'} {{(pid=94357) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 21 11:20:07.364622 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-7a9014c1-dcfd-4116-9868-25c50f131a99 tempest-AttachVolumeTestJSON-1736363069 tempest-AttachVolumeTestJSON-1736363069-project] [instance: 3543ca6f-9a27-4e0d-9376-c5ac8590a9eb] Selected host: n-h2-811414-3; Selected node: n-h2-811414-3; Alternates: [('n-h1-811414-3', 'n-h1-811414-3')] {{(pid=94357) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 21 11:20:07.365838 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-7a9014c1-dcfd-4116-9868-25c50f131a99 tempest-AttachVolumeTestJSON-1736363069 tempest-AttachVolumeTestJSON-1736363069-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:20:07.366244 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-7a9014c1-dcfd-4116-9868-25c50f131a99 tempest-AttachVolumeTestJSON-1736363069 tempest-AttachVolumeTestJSON-1736363069-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:20:07.382308 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-7a9014c1-dcfd-4116-9868-25c50f131a99 tempest-AttachVolumeTestJSON-1736363069 tempest-AttachVolumeTestJSON-1736363069-project] [instance: 3543ca6f-9a27-4e0d-9376-c5ac8590a9eb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f5cdc3d5-9524-4220-a7fc-ab5606975fdb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94357) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 21 11:20:07.385765 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-7a9014c1-dcfd-4116-9868-25c50f131a99 tempest-AttachVolumeTestJSON-1736363069 tempest-AttachVolumeTestJSON-1736363069-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:20:07.386445 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-7a9014c1-dcfd-4116-9868-25c50f131a99 tempest-AttachVolumeTestJSON-1736363069 tempest-AttachVolumeTestJSON-1736363069-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:20:07.426325 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-7a9014c1-dcfd-4116-9868-25c50f131a99 tempest-AttachVolumeTestJSON-1736363069 tempest-AttachVolumeTestJSON-1736363069-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:20:07.427235 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-7a9014c1-dcfd-4116-9868-25c50f131a99 tempest-AttachVolumeTestJSON-1736363069 tempest-AttachVolumeTestJSON-1736363069-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:20:23.432007 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-11787047-efd4-4115-9077-aa96b51ad2f7 tempest-TestNetworkAdvancedServerOps-151663419 tempest-TestNetworkAdvancedServerOps-151663419-project] Took 0.38 seconds to select destinations for 1 instance(s). {{(pid=94358) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 21 11:20:23.481913 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-11787047-efd4-4115-9077-aa96b51ad2f7 tempest-TestNetworkAdvancedServerOps-151663419 tempest-TestNetworkAdvancedServerOps-151663419-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:20:23.482316 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-11787047-efd4-4115-9077-aa96b51ad2f7 tempest-TestNetworkAdvancedServerOps-151663419 tempest-TestNetworkAdvancedServerOps-151663419-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:20:23.565469 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-11787047-efd4-4115-9077-aa96b51ad2f7 tempest-TestNetworkAdvancedServerOps-151663419 tempest-TestNetworkAdvancedServerOps-151663419-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:20:23.565867 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-11787047-efd4-4115-9077-aa96b51ad2f7 tempest-TestNetworkAdvancedServerOps-151663419 tempest-TestNetworkAdvancedServerOps-151663419-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:20:23.566581 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-11787047-efd4-4115-9077-aa96b51ad2f7 tempest-TestNetworkAdvancedServerOps-151663419 tempest-TestNetworkAdvancedServerOps-151663419-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:20:23.566969 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-11787047-efd4-4115-9077-aa96b51ad2f7 tempest-TestNetworkAdvancedServerOps-151663419 tempest-TestNetworkAdvancedServerOps-151663419-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:20:23.601416 n-d-811414-3 nova-conductor[94358]: DEBUG nova.quota [None req-11787047-efd4-4115-9077-aa96b51ad2f7 tempest-TestNetworkAdvancedServerOps-151663419 tempest-TestNetworkAdvancedServerOps-151663419-project] Getting quotas for project 2cd24407ec634f049086868ad62d3916. Resources: {'instances', 'cores', 'ram'} {{(pid=94358) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 21 11:20:23.608808 n-d-811414-3 nova-conductor[94358]: DEBUG nova.quota [None req-11787047-efd4-4115-9077-aa96b51ad2f7 tempest-TestNetworkAdvancedServerOps-151663419 tempest-TestNetworkAdvancedServerOps-151663419-project] Getting quotas for user 7353f8631717442ab4e8c6704e3b3708 and project 2cd24407ec634f049086868ad62d3916. Resources: {'instances', 'cores', 'ram'} {{(pid=94358) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 21 11:20:23.626823 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-11787047-efd4-4115-9077-aa96b51ad2f7 tempest-TestNetworkAdvancedServerOps-151663419 tempest-TestNetworkAdvancedServerOps-151663419-project] [instance: 5019ff66-e25c-4d11-af16-6b051fbbb64f] Selected host: n-h1-811414-3; Selected node: n-h1-811414-3; Alternates: [('n-h2-811414-3', 'n-h2-811414-3')] {{(pid=94358) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 21 11:20:23.628937 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-11787047-efd4-4115-9077-aa96b51ad2f7 tempest-TestNetworkAdvancedServerOps-151663419 tempest-TestNetworkAdvancedServerOps-151663419-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:20:23.629811 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-11787047-efd4-4115-9077-aa96b51ad2f7 tempest-TestNetworkAdvancedServerOps-151663419 tempest-TestNetworkAdvancedServerOps-151663419-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:20:23.639900 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-11787047-efd4-4115-9077-aa96b51ad2f7 tempest-TestNetworkAdvancedServerOps-151663419 tempest-TestNetworkAdvancedServerOps-151663419-project] [instance: 5019ff66-e25c-4d11-af16-6b051fbbb64f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f5cdc3d5-9524-4220-a7fc-ab5606975fdb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94358) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 21 11:20:23.641552 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-11787047-efd4-4115-9077-aa96b51ad2f7 tempest-TestNetworkAdvancedServerOps-151663419 tempest-TestNetworkAdvancedServerOps-151663419-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:20:23.642199 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-11787047-efd4-4115-9077-aa96b51ad2f7 tempest-TestNetworkAdvancedServerOps-151663419 tempest-TestNetworkAdvancedServerOps-151663419-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:20:23.693395 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-11787047-efd4-4115-9077-aa96b51ad2f7 tempest-TestNetworkAdvancedServerOps-151663419 tempest-TestNetworkAdvancedServerOps-151663419-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:20:23.693811 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-11787047-efd4-4115-9077-aa96b51ad2f7 tempest-TestNetworkAdvancedServerOps-151663419 tempest-TestNetworkAdvancedServerOps-151663419-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:20:31.486706 n-d-811414-3 nova-conductor[94357]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 21 11:20:43.095552 n-d-811414-3 nova-conductor[94358]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f60095b5-b68f-459e-af9a-3776dcd48c13] AMQP server on 10.222.0.13:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Apr 21 11:20:44.104159 n-d-811414-3 nova-conductor[94358]: INFO oslo.messaging._drivers.impl_rabbit [-] [f60095b5-b68f-459e-af9a-3776dcd48c13] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 37622. Apr 21 11:21:09.726851 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-037462e3-a813-4dc3-9383-9b6b8fb002b4 tempest-TestNetworkAdvancedServerOps-1762921480 tempest-TestNetworkAdvancedServerOps-1762921480-project-admin] Targeting cell 6c99d8ec-fb48-48af-b02b-a629a7c2cb6b(cell1) for conductor method migrate_server {{(pid=94357) wrapper /opt/stack/nova/nova/conductor/manager.py:91}} Apr 21 11:21:09.728125 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-037462e3-a813-4dc3-9383-9b6b8fb002b4 tempest-TestNetworkAdvancedServerOps-1762921480 tempest-TestNetworkAdvancedServerOps-1762921480-project-admin] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:21:09.728582 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-037462e3-a813-4dc3-9383-9b6b8fb002b4 tempest-TestNetworkAdvancedServerOps-1762921480 tempest-TestNetworkAdvancedServerOps-1762921480-project-admin] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:21:10.189534 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.tasks.migrate [None req-037462e3-a813-4dc3-9383-9b6b8fb002b4 tempest-TestNetworkAdvancedServerOps-1762921480 tempest-TestNetworkAdvancedServerOps-1762921480-project-admin] Created allocations for migration 1fe31e51-582d-4a3c-8673-5281c8978b68 on 43480f3a-fb09-463e-8326-6927c98a38b4 {{(pid=94357) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} Apr 21 11:21:10.472106 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.tasks.live_migrate [None req-037462e3-a813-4dc3-9383-9b6b8fb002b4 tempest-TestNetworkAdvancedServerOps-1762921480 tempest-TestNetworkAdvancedServerOps-1762921480-project-admin] [instance: 5019ff66-e25c-4d11-af16-6b051fbbb64f] Requesting cell 6c99d8ec-fb48-48af-b02b-a629a7c2cb6b(cell1) while live migrating {{(pid=94357) _get_request_spec_for_select_destinations /opt/stack/nova/nova/conductor/tasks/live_migrate.py:494}} Apr 21 11:21:10.713253 n-d-811414-3 nova-conductor[94357]: DEBUG nova.objects.instance [None req-037462e3-a813-4dc3-9383-9b6b8fb002b4 tempest-TestNetworkAdvancedServerOps-1762921480 tempest-TestNetworkAdvancedServerOps-1762921480-project-admin] Lazy-loading 'resources' on Instance uuid 5019ff66-e25c-4d11-af16-6b051fbbb64f {{(pid=94357) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Apr 21 11:21:10.718032 n-d-811414-3 nova-conductor[94357]: DEBUG nova.objects.instance [None req-037462e3-a813-4dc3-9383-9b6b8fb002b4 tempest-TestNetworkAdvancedServerOps-1762921480 tempest-TestNetworkAdvancedServerOps-1762921480-project-admin] Lazy-loading 'pci_requests' on Instance uuid 5019ff66-e25c-4d11-af16-6b051fbbb64f {{(pid=94357) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Apr 21 11:21:11.119490 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.tasks.live_migrate [None req-037462e3-a813-4dc3-9383-9b6b8fb002b4 tempest-TestNetworkAdvancedServerOps-1762921480 tempest-TestNetworkAdvancedServerOps-1762921480-project-admin] [instance: 5019ff66-e25c-4d11-af16-6b051fbbb64f] Start binding ports on destination host: n-h2-811414-3 {{(pid=94357) _bind_ports_on_destination /opt/stack/nova/nova/conductor/tasks/live_migrate.py:389}} Apr 21 11:21:40.270817 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-e3ddac29-3e3c-4671-8019-0cb100123dd8 tempest-TestVolumeBootPattern-1683621464 tempest-TestVolumeBootPattern-1683621464-project] Took 0.30 seconds to select destinations for 1 instance(s). {{(pid=94358) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 21 11:21:40.304213 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-e3ddac29-3e3c-4671-8019-0cb100123dd8 tempest-TestVolumeBootPattern-1683621464 tempest-TestVolumeBootPattern-1683621464-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:21:40.304875 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-e3ddac29-3e3c-4671-8019-0cb100123dd8 tempest-TestVolumeBootPattern-1683621464 tempest-TestVolumeBootPattern-1683621464-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:21:40.357198 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-e3ddac29-3e3c-4671-8019-0cb100123dd8 tempest-TestVolumeBootPattern-1683621464 tempest-TestVolumeBootPattern-1683621464-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:21:40.369210 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-e3ddac29-3e3c-4671-8019-0cb100123dd8 tempest-TestVolumeBootPattern-1683621464 tempest-TestVolumeBootPattern-1683621464-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:21:40.372763 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-e3ddac29-3e3c-4671-8019-0cb100123dd8 tempest-TestVolumeBootPattern-1683621464 tempest-TestVolumeBootPattern-1683621464-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:21:40.377438 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-e3ddac29-3e3c-4671-8019-0cb100123dd8 tempest-TestVolumeBootPattern-1683621464 tempest-TestVolumeBootPattern-1683621464-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:21:40.401383 n-d-811414-3 nova-conductor[94358]: DEBUG nova.quota [None req-e3ddac29-3e3c-4671-8019-0cb100123dd8 tempest-TestVolumeBootPattern-1683621464 tempest-TestVolumeBootPattern-1683621464-project] Getting quotas for project eb539520fc5e47a8b097c107b50f602c. Resources: {'instances', 'cores', 'ram'} {{(pid=94358) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 21 11:21:40.406769 n-d-811414-3 nova-conductor[94358]: DEBUG nova.quota [None req-e3ddac29-3e3c-4671-8019-0cb100123dd8 tempest-TestVolumeBootPattern-1683621464 tempest-TestVolumeBootPattern-1683621464-project] Getting quotas for user 5ccc090867c04164a1429e908a4913cc and project eb539520fc5e47a8b097c107b50f602c. Resources: {'instances', 'cores', 'ram'} {{(pid=94358) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 21 11:21:40.419509 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-e3ddac29-3e3c-4671-8019-0cb100123dd8 tempest-TestVolumeBootPattern-1683621464 tempest-TestVolumeBootPattern-1683621464-project] [instance: 7f8a9f6e-9e1b-4251-933f-6a074b9ce10f] Selected host: n-h1-811414-3; Selected node: n-h1-811414-3; Alternates: [('n-h2-811414-3', 'n-h2-811414-3')] {{(pid=94358) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 21 11:21:40.420713 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-e3ddac29-3e3c-4671-8019-0cb100123dd8 tempest-TestVolumeBootPattern-1683621464 tempest-TestVolumeBootPattern-1683621464-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:21:40.421247 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-e3ddac29-3e3c-4671-8019-0cb100123dd8 tempest-TestVolumeBootPattern-1683621464 tempest-TestVolumeBootPattern-1683621464-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:21:40.429476 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-e3ddac29-3e3c-4671-8019-0cb100123dd8 tempest-TestVolumeBootPattern-1683621464 tempest-TestVolumeBootPattern-1683621464-project] [instance: 7f8a9f6e-9e1b-4251-933f-6a074b9ce10f] block_device_mapping [BlockDeviceMapping(attachment_id=a7f84b3e-f1b5-4698-95ed-8ea168c3feef,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='4cf0cf18-42f7-44cf-affb-c4fdd40d358c',volume_size=1,volume_type=None)] {{(pid=94358) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 21 11:21:40.431891 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-e3ddac29-3e3c-4671-8019-0cb100123dd8 tempest-TestVolumeBootPattern-1683621464 tempest-TestVolumeBootPattern-1683621464-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:21:40.432526 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-e3ddac29-3e3c-4671-8019-0cb100123dd8 tempest-TestVolumeBootPattern-1683621464 tempest-TestVolumeBootPattern-1683621464-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:21:40.483422 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-e3ddac29-3e3c-4671-8019-0cb100123dd8 tempest-TestVolumeBootPattern-1683621464 tempest-TestVolumeBootPattern-1683621464-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:21:40.483895 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-e3ddac29-3e3c-4671-8019-0cb100123dd8 tempest-TestVolumeBootPattern-1683621464 tempest-TestVolumeBootPattern-1683621464-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:21:57.824322 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-be417bff-1c73-448e-8740-7a88df7e0b7c tempest-TestNetworkAdvancedServerOps-151663419 tempest-TestNetworkAdvancedServerOps-151663419-project] Took 0.47 seconds to select destinations for 1 instance(s). {{(pid=94357) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 21 11:21:57.871723 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-be417bff-1c73-448e-8740-7a88df7e0b7c tempest-TestNetworkAdvancedServerOps-151663419 tempest-TestNetworkAdvancedServerOps-151663419-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:21:57.871723 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-be417bff-1c73-448e-8740-7a88df7e0b7c tempest-TestNetworkAdvancedServerOps-151663419 tempest-TestNetworkAdvancedServerOps-151663419-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:21:57.981989 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-be417bff-1c73-448e-8740-7a88df7e0b7c tempest-TestNetworkAdvancedServerOps-151663419 tempest-TestNetworkAdvancedServerOps-151663419-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:21:57.981989 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-be417bff-1c73-448e-8740-7a88df7e0b7c tempest-TestNetworkAdvancedServerOps-151663419 tempest-TestNetworkAdvancedServerOps-151663419-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:21:57.981989 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-be417bff-1c73-448e-8740-7a88df7e0b7c tempest-TestNetworkAdvancedServerOps-151663419 tempest-TestNetworkAdvancedServerOps-151663419-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:21:57.981989 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-be417bff-1c73-448e-8740-7a88df7e0b7c tempest-TestNetworkAdvancedServerOps-151663419 tempest-TestNetworkAdvancedServerOps-151663419-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:21:57.999021 n-d-811414-3 nova-conductor[94357]: DEBUG nova.quota [None req-be417bff-1c73-448e-8740-7a88df7e0b7c tempest-TestNetworkAdvancedServerOps-151663419 tempest-TestNetworkAdvancedServerOps-151663419-project] Getting quotas for project 2cd24407ec634f049086868ad62d3916. Resources: {'instances', 'cores', 'ram'} {{(pid=94357) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 21 11:21:58.000884 n-d-811414-3 nova-conductor[94357]: DEBUG nova.quota [None req-be417bff-1c73-448e-8740-7a88df7e0b7c tempest-TestNetworkAdvancedServerOps-151663419 tempest-TestNetworkAdvancedServerOps-151663419-project] Getting quotas for user 7353f8631717442ab4e8c6704e3b3708 and project 2cd24407ec634f049086868ad62d3916. Resources: {'instances', 'cores', 'ram'} {{(pid=94357) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 21 11:21:58.012562 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-be417bff-1c73-448e-8740-7a88df7e0b7c tempest-TestNetworkAdvancedServerOps-151663419 tempest-TestNetworkAdvancedServerOps-151663419-project] [instance: 2117994b-fa49-4239-9e0d-142e94319c08] Selected host: n-h2-811414-3; Selected node: n-h2-811414-3; Alternates: [('n-h1-811414-3', 'n-h1-811414-3')] {{(pid=94357) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 21 11:21:58.013499 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-be417bff-1c73-448e-8740-7a88df7e0b7c tempest-TestNetworkAdvancedServerOps-151663419 tempest-TestNetworkAdvancedServerOps-151663419-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:21:58.013895 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-be417bff-1c73-448e-8740-7a88df7e0b7c tempest-TestNetworkAdvancedServerOps-151663419 tempest-TestNetworkAdvancedServerOps-151663419-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:21:58.022126 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-be417bff-1c73-448e-8740-7a88df7e0b7c tempest-TestNetworkAdvancedServerOps-151663419 tempest-TestNetworkAdvancedServerOps-151663419-project] [instance: 2117994b-fa49-4239-9e0d-142e94319c08] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f5cdc3d5-9524-4220-a7fc-ab5606975fdb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94357) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 21 11:21:58.023572 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-be417bff-1c73-448e-8740-7a88df7e0b7c tempest-TestNetworkAdvancedServerOps-151663419 tempest-TestNetworkAdvancedServerOps-151663419-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:21:58.024068 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-be417bff-1c73-448e-8740-7a88df7e0b7c tempest-TestNetworkAdvancedServerOps-151663419 tempest-TestNetworkAdvancedServerOps-151663419-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:21:58.098492 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-be417bff-1c73-448e-8740-7a88df7e0b7c tempest-TestNetworkAdvancedServerOps-151663419 tempest-TestNetworkAdvancedServerOps-151663419-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:21:58.098891 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-be417bff-1c73-448e-8740-7a88df7e0b7c tempest-TestNetworkAdvancedServerOps-151663419 tempest-TestNetworkAdvancedServerOps-151663419-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:22:46.306183 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-5edf05d1-e315-4245-9c42-3508d02aa7b8 tempest-TestNetworkAdvancedServerOps-151663419 tempest-TestNetworkAdvancedServerOps-151663419-project] Targeting cell 6c99d8ec-fb48-48af-b02b-a629a7c2cb6b(cell1) for conductor method rebuild_instance {{(pid=94358) wrapper /opt/stack/nova/nova/conductor/manager.py:91}} Apr 21 11:22:46.306645 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-5edf05d1-e315-4245-9c42-3508d02aa7b8 tempest-TestNetworkAdvancedServerOps-151663419 tempest-TestNetworkAdvancedServerOps-151663419-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:22:46.307045 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-5edf05d1-e315-4245-9c42-3508d02aa7b8 tempest-TestNetworkAdvancedServerOps-151663419 tempest-TestNetworkAdvancedServerOps-151663419-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:22:46.326217 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-5edf05d1-e315-4245-9c42-3508d02aa7b8 tempest-TestNetworkAdvancedServerOps-151663419 tempest-TestNetworkAdvancedServerOps-151663419-project] [instance: 2117994b-fa49-4239-9e0d-142e94319c08] No migration record for the rebuild/evacuate request. {{(pid=94358) rebuild_instance /opt/stack/nova/nova/conductor/manager.py:1101}} Apr 21 11:22:46.329098 n-d-811414-3 nova-conductor[94358]: ERROR oslo.messaging._drivers.impl_rabbit [None req-5edf05d1-e315-4245-9c42-3508d02aa7b8 tempest-TestNetworkAdvancedServerOps-151663419 tempest-TestNetworkAdvancedServerOps-151663419-project] [df22162b-3e07-4ce8-8eaf-cebcf06dad53] AMQP server on 10.222.0.13:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Apr 21 11:22:47.338341 n-d-811414-3 nova-conductor[94358]: INFO oslo.messaging._drivers.impl_rabbit [None req-5edf05d1-e315-4245-9c42-3508d02aa7b8 tempest-TestNetworkAdvancedServerOps-151663419 tempest-TestNetworkAdvancedServerOps-151663419-project] [df22162b-3e07-4ce8-8eaf-cebcf06dad53] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 41118. Apr 21 11:23:39.331513 n-d-811414-3 nova-conductor[94357]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6404cb3a-bdc9-481c-93a6-d63501b53d9b] AMQP server on 10.222.0.13:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 21 11:23:40.342095 n-d-811414-3 nova-conductor[94357]: INFO oslo.messaging._drivers.impl_rabbit [-] [6404cb3a-bdc9-481c-93a6-d63501b53d9b] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 41716. Apr 21 11:23:44.101569 n-d-811414-3 nova-conductor[94358]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f60095b5-b68f-459e-af9a-3776dcd48c13] AMQP server on 10.222.0.13:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Apr 21 11:23:45.109911 n-d-811414-3 nova-conductor[94358]: INFO oslo.messaging._drivers.impl_rabbit [-] [f60095b5-b68f-459e-af9a-3776dcd48c13] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 41766. Apr 21 11:23:51.489510 n-d-811414-3 nova-conductor[94357]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 21 11:23:55.084197 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-d5f64ede-e658-4bc2-bb27-2cfd3d8fba18 tempest-TestVolumeBootPattern-1683621464 tempest-TestVolumeBootPattern-1683621464-project] Took 0.29 seconds to select destinations for 1 instance(s). {{(pid=94357) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 21 11:23:55.114108 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-d5f64ede-e658-4bc2-bb27-2cfd3d8fba18 tempest-TestVolumeBootPattern-1683621464 tempest-TestVolumeBootPattern-1683621464-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:23:55.114730 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-d5f64ede-e658-4bc2-bb27-2cfd3d8fba18 tempest-TestVolumeBootPattern-1683621464 tempest-TestVolumeBootPattern-1683621464-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:23:55.164923 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-d5f64ede-e658-4bc2-bb27-2cfd3d8fba18 tempest-TestVolumeBootPattern-1683621464 tempest-TestVolumeBootPattern-1683621464-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:23:55.165588 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-d5f64ede-e658-4bc2-bb27-2cfd3d8fba18 tempest-TestVolumeBootPattern-1683621464 tempest-TestVolumeBootPattern-1683621464-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:23:55.166483 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-d5f64ede-e658-4bc2-bb27-2cfd3d8fba18 tempest-TestVolumeBootPattern-1683621464 tempest-TestVolumeBootPattern-1683621464-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:23:55.167061 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-d5f64ede-e658-4bc2-bb27-2cfd3d8fba18 tempest-TestVolumeBootPattern-1683621464 tempest-TestVolumeBootPattern-1683621464-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:23:55.185799 n-d-811414-3 nova-conductor[94357]: DEBUG nova.quota [None req-d5f64ede-e658-4bc2-bb27-2cfd3d8fba18 tempest-TestVolumeBootPattern-1683621464 tempest-TestVolumeBootPattern-1683621464-project] Getting quotas for project eb539520fc5e47a8b097c107b50f602c. Resources: {'instances', 'cores', 'ram'} {{(pid=94357) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 21 11:23:55.190824 n-d-811414-3 nova-conductor[94357]: DEBUG nova.quota [None req-d5f64ede-e658-4bc2-bb27-2cfd3d8fba18 tempest-TestVolumeBootPattern-1683621464 tempest-TestVolumeBootPattern-1683621464-project] Getting quotas for user 5ccc090867c04164a1429e908a4913cc and project eb539520fc5e47a8b097c107b50f602c. Resources: {'instances', 'cores', 'ram'} {{(pid=94357) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 21 11:23:55.213205 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-d5f64ede-e658-4bc2-bb27-2cfd3d8fba18 tempest-TestVolumeBootPattern-1683621464 tempest-TestVolumeBootPattern-1683621464-project] [instance: 957ac241-5958-4e0d-960d-1509d4ef6883] Selected host: n-h2-811414-3; Selected node: n-h2-811414-3; Alternates: [('n-h1-811414-3', 'n-h1-811414-3')] {{(pid=94357) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 21 11:23:55.214402 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-d5f64ede-e658-4bc2-bb27-2cfd3d8fba18 tempest-TestVolumeBootPattern-1683621464 tempest-TestVolumeBootPattern-1683621464-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:23:55.215050 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-d5f64ede-e658-4bc2-bb27-2cfd3d8fba18 tempest-TestVolumeBootPattern-1683621464 tempest-TestVolumeBootPattern-1683621464-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:23:55.224319 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-d5f64ede-e658-4bc2-bb27-2cfd3d8fba18 tempest-TestVolumeBootPattern-1683621464 tempest-TestVolumeBootPattern-1683621464-project] [instance: 957ac241-5958-4e0d-960d-1509d4ef6883] block_device_mapping [BlockDeviceMapping(attachment_id=5d5adb27-6b33-4296-8dce-ef76ab87ce7b,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='fa2afb7b-6551-4ce4-8c98-8490d5eb19df',volume_size=1,volume_type=None)] {{(pid=94357) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 21 11:23:55.226337 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-d5f64ede-e658-4bc2-bb27-2cfd3d8fba18 tempest-TestVolumeBootPattern-1683621464 tempest-TestVolumeBootPattern-1683621464-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:23:55.228321 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-d5f64ede-e658-4bc2-bb27-2cfd3d8fba18 tempest-TestVolumeBootPattern-1683621464 tempest-TestVolumeBootPattern-1683621464-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:23:55.266793 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-d5f64ede-e658-4bc2-bb27-2cfd3d8fba18 tempest-TestVolumeBootPattern-1683621464 tempest-TestVolumeBootPattern-1683621464-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:23:55.267407 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-d5f64ede-e658-4bc2-bb27-2cfd3d8fba18 tempest-TestVolumeBootPattern-1683621464 tempest-TestVolumeBootPattern-1683621464-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:24:02.275839 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-3c114e3a-4007-42c0-973c-79fdf6424584 tempest-TestServerAdvancedOps-91911855 tempest-TestServerAdvancedOps-91911855-project] Took 0.25 seconds to select destinations for 1 instance(s). {{(pid=94358) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 21 11:24:02.301526 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-3c114e3a-4007-42c0-973c-79fdf6424584 tempest-TestServerAdvancedOps-91911855 tempest-TestServerAdvancedOps-91911855-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:24:02.301922 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-3c114e3a-4007-42c0-973c-79fdf6424584 tempest-TestServerAdvancedOps-91911855 tempest-TestServerAdvancedOps-91911855-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:24:02.366517 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-3c114e3a-4007-42c0-973c-79fdf6424584 tempest-TestServerAdvancedOps-91911855 tempest-TestServerAdvancedOps-91911855-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:24:02.366924 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-3c114e3a-4007-42c0-973c-79fdf6424584 tempest-TestServerAdvancedOps-91911855 tempest-TestServerAdvancedOps-91911855-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:24:02.367855 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-3c114e3a-4007-42c0-973c-79fdf6424584 tempest-TestServerAdvancedOps-91911855 tempest-TestServerAdvancedOps-91911855-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:24:02.368290 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-3c114e3a-4007-42c0-973c-79fdf6424584 tempest-TestServerAdvancedOps-91911855 tempest-TestServerAdvancedOps-91911855-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:24:02.386913 n-d-811414-3 nova-conductor[94358]: DEBUG nova.quota [None req-3c114e3a-4007-42c0-973c-79fdf6424584 tempest-TestServerAdvancedOps-91911855 tempest-TestServerAdvancedOps-91911855-project] Getting quotas for project 1e3685c42df94474b161d86c7e426158. Resources: {'instances', 'cores', 'ram'} {{(pid=94358) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 21 11:24:02.392657 n-d-811414-3 nova-conductor[94358]: DEBUG nova.quota [None req-3c114e3a-4007-42c0-973c-79fdf6424584 tempest-TestServerAdvancedOps-91911855 tempest-TestServerAdvancedOps-91911855-project] Getting quotas for user 7a7c1ca0508341289e00dfe7b332e025 and project 1e3685c42df94474b161d86c7e426158. Resources: {'instances', 'cores', 'ram'} {{(pid=94358) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 21 11:24:02.406096 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-3c114e3a-4007-42c0-973c-79fdf6424584 tempest-TestServerAdvancedOps-91911855 tempest-TestServerAdvancedOps-91911855-project] [instance: 5373f51e-1270-4f0b-9017-3cd96d97a410] Selected host: n-h1-811414-3; Selected node: n-h1-811414-3; Alternates: [('n-h2-811414-3', 'n-h2-811414-3')] {{(pid=94358) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 21 11:24:02.407503 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-3c114e3a-4007-42c0-973c-79fdf6424584 tempest-TestServerAdvancedOps-91911855 tempest-TestServerAdvancedOps-91911855-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:24:02.408327 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-3c114e3a-4007-42c0-973c-79fdf6424584 tempest-TestServerAdvancedOps-91911855 tempest-TestServerAdvancedOps-91911855-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:24:02.416900 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-3c114e3a-4007-42c0-973c-79fdf6424584 tempest-TestServerAdvancedOps-91911855 tempest-TestServerAdvancedOps-91911855-project] [instance: 5373f51e-1270-4f0b-9017-3cd96d97a410] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f5cdc3d5-9524-4220-a7fc-ab5606975fdb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94358) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 21 11:24:02.418101 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-3c114e3a-4007-42c0-973c-79fdf6424584 tempest-TestServerAdvancedOps-91911855 tempest-TestServerAdvancedOps-91911855-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:24:02.418503 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-3c114e3a-4007-42c0-973c-79fdf6424584 tempest-TestServerAdvancedOps-91911855 tempest-TestServerAdvancedOps-91911855-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:24:02.449788 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-3c114e3a-4007-42c0-973c-79fdf6424584 tempest-TestServerAdvancedOps-91911855 tempest-TestServerAdvancedOps-91911855-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:24:02.450072 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-3c114e3a-4007-42c0-973c-79fdf6424584 tempest-TestServerAdvancedOps-91911855 tempest-TestServerAdvancedOps-91911855-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:26:19.480139 n-d-811414-3 nova-conductor[94358]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f74a9f7c-07ff-404c-aef6-df527a438fd3] AMQP server on 10.222.0.13:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 21 11:26:20.487194 n-d-811414-3 nova-conductor[94358]: INFO oslo.messaging._drivers.impl_rabbit [-] [f74a9f7c-07ff-404c-aef6-df527a438fd3] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 43486. Apr 21 11:26:20.959351 n-d-811414-3 nova-conductor[94357]: ERROR oslo.messaging._drivers.impl_rabbit [-] [511a12d4-04a9-4f3f-bc69-0b6739fdbf60] AMQP server on 10.222.0.13:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 21 11:26:21.967761 n-d-811414-3 nova-conductor[94357]: INFO oslo.messaging._drivers.impl_rabbit [-] [511a12d4-04a9-4f3f-bc69-0b6739fdbf60] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 43520. Apr 21 11:26:29.315268 n-d-811414-3 nova-conductor[94357]: ERROR oslo.messaging._drivers.impl_rabbit [-] [694bc511-65ea-420f-8d85-4aed262a2a29] AMQP server on 10.222.0.13:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 21 11:26:30.318794 n-d-811414-3 nova-conductor[94358]: ERROR oslo.messaging._drivers.impl_rabbit [-] [764b4c1f-4a95-4767-989c-d3f562ce3759] AMQP server on 10.222.0.13:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 21 11:26:30.330165 n-d-811414-3 nova-conductor[94357]: INFO oslo.messaging._drivers.impl_rabbit [-] [694bc511-65ea-420f-8d85-4aed262a2a29] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 43592. Apr 21 11:26:31.335918 n-d-811414-3 nova-conductor[94358]: INFO oslo.messaging._drivers.impl_rabbit [-] [764b4c1f-4a95-4767-989c-d3f562ce3759] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 43614. Apr 21 11:26:38.531184 n-d-811414-3 nova-conductor[94358]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 21 11:26:40.341462 n-d-811414-3 nova-conductor[94357]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6404cb3a-bdc9-481c-93a6-d63501b53d9b] AMQP server on 10.222.0.13:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 21 11:26:41.026057 n-d-811414-3 nova-conductor[94357]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 21 11:26:41.208985 n-d-811414-3 nova-conductor[94358]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 21 11:26:41.349695 n-d-811414-3 nova-conductor[94357]: INFO oslo.messaging._drivers.impl_rabbit [-] [6404cb3a-bdc9-481c-93a6-d63501b53d9b] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 43760. Apr 21 11:26:42.272127 n-d-811414-3 nova-conductor[94357]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 21 11:26:45.111570 n-d-811414-3 nova-conductor[94358]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f60095b5-b68f-459e-af9a-3776dcd48c13] AMQP server on 10.222.0.13:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 21 11:26:46.120634 n-d-811414-3 nova-conductor[94358]: INFO oslo.messaging._drivers.impl_rabbit [-] [f60095b5-b68f-459e-af9a-3776dcd48c13] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 43800. Apr 21 11:27:11.499083 n-d-811414-3 nova-conductor[94357]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 21 11:27:34.663669 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-69835228-89ae-4911-914a-56b0ee8a2c45 tempest-ServersAdminNegativeTestJSON-1046265735 tempest-ServersAdminNegativeTestJSON-1046265735-project] Took 0.49 seconds to select destinations for 1 instance(s). {{(pid=94357) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 21 11:27:34.686725 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-69835228-89ae-4911-914a-56b0ee8a2c45 tempest-ServersAdminNegativeTestJSON-1046265735 tempest-ServersAdminNegativeTestJSON-1046265735-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:27:34.687115 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-69835228-89ae-4911-914a-56b0ee8a2c45 tempest-ServersAdminNegativeTestJSON-1046265735 tempest-ServersAdminNegativeTestJSON-1046265735-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:27:34.732346 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-69835228-89ae-4911-914a-56b0ee8a2c45 tempest-ServersAdminNegativeTestJSON-1046265735 tempest-ServersAdminNegativeTestJSON-1046265735-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:27:34.732903 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-69835228-89ae-4911-914a-56b0ee8a2c45 tempest-ServersAdminNegativeTestJSON-1046265735 tempest-ServersAdminNegativeTestJSON-1046265735-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:27:34.733633 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-69835228-89ae-4911-914a-56b0ee8a2c45 tempest-ServersAdminNegativeTestJSON-1046265735 tempest-ServersAdminNegativeTestJSON-1046265735-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:27:34.734016 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-69835228-89ae-4911-914a-56b0ee8a2c45 tempest-ServersAdminNegativeTestJSON-1046265735 tempest-ServersAdminNegativeTestJSON-1046265735-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:27:34.749555 n-d-811414-3 nova-conductor[94357]: DEBUG nova.quota [None req-69835228-89ae-4911-914a-56b0ee8a2c45 tempest-ServersAdminNegativeTestJSON-1046265735 tempest-ServersAdminNegativeTestJSON-1046265735-project] Getting quotas for project 9fa9fade6c554f6c80f1bb5eb3ddae91. Resources: {'instances', 'cores', 'ram'} {{(pid=94357) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 21 11:27:34.753929 n-d-811414-3 nova-conductor[94357]: DEBUG nova.quota [None req-69835228-89ae-4911-914a-56b0ee8a2c45 tempest-ServersAdminNegativeTestJSON-1046265735 tempest-ServersAdminNegativeTestJSON-1046265735-project] Getting quotas for user ffc05d6bf8ed48d1847077e70fb7e534 and project 9fa9fade6c554f6c80f1bb5eb3ddae91. Resources: {'instances', 'cores', 'ram'} {{(pid=94357) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 21 11:27:34.763916 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-69835228-89ae-4911-914a-56b0ee8a2c45 tempest-ServersAdminNegativeTestJSON-1046265735 tempest-ServersAdminNegativeTestJSON-1046265735-project] [instance: 09839e10-4ee9-41c9-921d-22436962a875] Selected host: n-h1-811414-3; Selected node: n-h1-811414-3; Alternates: [('n-h2-811414-3', 'n-h2-811414-3')] {{(pid=94357) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 21 11:27:34.764853 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-69835228-89ae-4911-914a-56b0ee8a2c45 tempest-ServersAdminNegativeTestJSON-1046265735 tempest-ServersAdminNegativeTestJSON-1046265735-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:27:34.765244 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-69835228-89ae-4911-914a-56b0ee8a2c45 tempest-ServersAdminNegativeTestJSON-1046265735 tempest-ServersAdminNegativeTestJSON-1046265735-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:27:34.772805 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-69835228-89ae-4911-914a-56b0ee8a2c45 tempest-ServersAdminNegativeTestJSON-1046265735 tempest-ServersAdminNegativeTestJSON-1046265735-project] [instance: 09839e10-4ee9-41c9-921d-22436962a875] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f5cdc3d5-9524-4220-a7fc-ab5606975fdb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94357) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 21 11:27:34.773971 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-69835228-89ae-4911-914a-56b0ee8a2c45 tempest-ServersAdminNegativeTestJSON-1046265735 tempest-ServersAdminNegativeTestJSON-1046265735-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:27:34.774340 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-69835228-89ae-4911-914a-56b0ee8a2c45 tempest-ServersAdminNegativeTestJSON-1046265735 tempest-ServersAdminNegativeTestJSON-1046265735-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:27:34.799164 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-69835228-89ae-4911-914a-56b0ee8a2c45 tempest-ServersAdminNegativeTestJSON-1046265735 tempest-ServersAdminNegativeTestJSON-1046265735-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:27:34.799614 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-69835228-89ae-4911-914a-56b0ee8a2c45 tempest-ServersAdminNegativeTestJSON-1046265735 tempest-ServersAdminNegativeTestJSON-1046265735-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:27:53.059975 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-12f5a442-9087-4e03-92a0-2936bf77cd74 tempest-DeleteServersTestJSON-1149176010 tempest-DeleteServersTestJSON-1149176010-project] Took 0.47 seconds to select destinations for 1 instance(s). {{(pid=94358) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 21 11:27:53.082481 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-12f5a442-9087-4e03-92a0-2936bf77cd74 tempest-DeleteServersTestJSON-1149176010 tempest-DeleteServersTestJSON-1149176010-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:27:53.082890 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-12f5a442-9087-4e03-92a0-2936bf77cd74 tempest-DeleteServersTestJSON-1149176010 tempest-DeleteServersTestJSON-1149176010-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:27:53.134507 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-12f5a442-9087-4e03-92a0-2936bf77cd74 tempest-DeleteServersTestJSON-1149176010 tempest-DeleteServersTestJSON-1149176010-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:27:53.134909 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-12f5a442-9087-4e03-92a0-2936bf77cd74 tempest-DeleteServersTestJSON-1149176010 tempest-DeleteServersTestJSON-1149176010-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:27:53.135628 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-12f5a442-9087-4e03-92a0-2936bf77cd74 tempest-DeleteServersTestJSON-1149176010 tempest-DeleteServersTestJSON-1149176010-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:27:53.136012 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-12f5a442-9087-4e03-92a0-2936bf77cd74 tempest-DeleteServersTestJSON-1149176010 tempest-DeleteServersTestJSON-1149176010-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:27:53.151167 n-d-811414-3 nova-conductor[94358]: DEBUG nova.quota [None req-12f5a442-9087-4e03-92a0-2936bf77cd74 tempest-DeleteServersTestJSON-1149176010 tempest-DeleteServersTestJSON-1149176010-project] Getting quotas for project 93eccdcb5a364787bb98974d3ed97aab. Resources: {'instances', 'cores', 'ram'} {{(pid=94358) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 21 11:27:53.156100 n-d-811414-3 nova-conductor[94358]: DEBUG nova.quota [None req-12f5a442-9087-4e03-92a0-2936bf77cd74 tempest-DeleteServersTestJSON-1149176010 tempest-DeleteServersTestJSON-1149176010-project] Getting quotas for user 4a12346a482648459cbf408af7f1608e and project 93eccdcb5a364787bb98974d3ed97aab. Resources: {'instances', 'cores', 'ram'} {{(pid=94358) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 21 11:27:53.166679 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-12f5a442-9087-4e03-92a0-2936bf77cd74 tempest-DeleteServersTestJSON-1149176010 tempest-DeleteServersTestJSON-1149176010-project] [instance: 74a3a4ca-a249-4fb8-8330-4115ec384699] Selected host: n-h1-811414-3; Selected node: n-h1-811414-3; Alternates: [('n-h2-811414-3', 'n-h2-811414-3')] {{(pid=94358) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 21 11:27:53.167581 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-12f5a442-9087-4e03-92a0-2936bf77cd74 tempest-DeleteServersTestJSON-1149176010 tempest-DeleteServersTestJSON-1149176010-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:27:53.167979 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-12f5a442-9087-4e03-92a0-2936bf77cd74 tempest-DeleteServersTestJSON-1149176010 tempest-DeleteServersTestJSON-1149176010-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:27:53.174168 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-12f5a442-9087-4e03-92a0-2936bf77cd74 tempest-DeleteServersTestJSON-1149176010 tempest-DeleteServersTestJSON-1149176010-project] [instance: 74a3a4ca-a249-4fb8-8330-4115ec384699] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f5cdc3d5-9524-4220-a7fc-ab5606975fdb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94358) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 21 11:27:53.175334 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-12f5a442-9087-4e03-92a0-2936bf77cd74 tempest-DeleteServersTestJSON-1149176010 tempest-DeleteServersTestJSON-1149176010-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:27:53.175731 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-12f5a442-9087-4e03-92a0-2936bf77cd74 tempest-DeleteServersTestJSON-1149176010 tempest-DeleteServersTestJSON-1149176010-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:27:53.203003 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-12f5a442-9087-4e03-92a0-2936bf77cd74 tempest-DeleteServersTestJSON-1149176010 tempest-DeleteServersTestJSON-1149176010-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:27:53.203425 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-12f5a442-9087-4e03-92a0-2936bf77cd74 tempest-DeleteServersTestJSON-1149176010 tempest-DeleteServersTestJSON-1149176010-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:27:58.429716 n-d-811414-3 nova-conductor[94358]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 21 11:28:02.864063 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-04a7886f-e6ce-483d-bc78-aec5cdd7fe5c tempest-DeleteServersTestJSON-1149176010 tempest-DeleteServersTestJSON-1149176010-project] Targeting cell 6c99d8ec-fb48-48af-b02b-a629a7c2cb6b(cell1) for conductor method migrate_server {{(pid=94357) wrapper /opt/stack/nova/nova/conductor/manager.py:91}} Apr 21 11:28:02.864611 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-04a7886f-e6ce-483d-bc78-aec5cdd7fe5c tempest-DeleteServersTestJSON-1149176010 tempest-DeleteServersTestJSON-1149176010-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:28:02.864958 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-04a7886f-e6ce-483d-bc78-aec5cdd7fe5c tempest-DeleteServersTestJSON-1149176010 tempest-DeleteServersTestJSON-1149176010-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:28:03.081095 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.tasks.migrate [None req-04a7886f-e6ce-483d-bc78-aec5cdd7fe5c tempest-DeleteServersTestJSON-1149176010 tempest-DeleteServersTestJSON-1149176010-project] [instance: 74a3a4ca-a249-4fb8-8330-4115ec384699] Restricting to cell 6c99d8ec-fb48-48af-b02b-a629a7c2cb6b(cell1) while migrating {{(pid=94357) _set_requested_destination_cell /opt/stack/nova/nova/conductor/tasks/migrate.py:208}} Apr 21 11:28:03.354255 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.tasks.migrate [None req-04a7886f-e6ce-483d-bc78-aec5cdd7fe5c tempest-DeleteServersTestJSON-1149176010 tempest-DeleteServersTestJSON-1149176010-project] Created allocations for migration 078e336b-3083-4505-bf79-348175ce21a9 on 43480f3a-fb09-463e-8326-6927c98a38b4 {{(pid=94357) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} Apr 21 11:28:03.561190 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.tasks.migrate [None req-04a7886f-e6ce-483d-bc78-aec5cdd7fe5c tempest-DeleteServersTestJSON-1149176010 tempest-DeleteServersTestJSON-1149176010-project] [instance: 74a3a4ca-a249-4fb8-8330-4115ec384699] Calling prep_resize with selected host: n-h2-811414-3; Selected node: n-h2-811414-3; Alternates: [Selection(allocation_request='{"allocations": {"43480f3a-fb09-463e-8326-6927c98a38b4": {"resources": {"DISK_GB": 1, "MEMORY_MB": 512, "VCPU": 1}}}, "mappings": {"": ["43480f3a-fb09-463e-8326-6927c98a38b4"]}}',allocation_request_version='1.35',availability_zone='nova',cell_uuid=6c99d8ec-fb48-48af-b02b-a629a7c2cb6b,compute_node_uuid=43480f3a-fb09-463e-8326-6927c98a38b4,limits=SchedulerLimits,nodename='n-h1-811414-3',service_host='n-h1-811414-3')] {{(pid=94357) _execute /opt/stack/nova/nova/conductor/tasks/migrate.py:315}} Apr 21 11:28:45.756662 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-3a6c0029-dc52-4ac1-a7dd-9557417f269d tempest-ServerDiskConfigTestJSON-758289522 tempest-ServerDiskConfigTestJSON-758289522-project] Took 0.21 seconds to select destinations for 1 instance(s). {{(pid=94358) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 21 11:28:45.778544 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-3a6c0029-dc52-4ac1-a7dd-9557417f269d tempest-ServerDiskConfigTestJSON-758289522 tempest-ServerDiskConfigTestJSON-758289522-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:28:45.778949 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-3a6c0029-dc52-4ac1-a7dd-9557417f269d tempest-ServerDiskConfigTestJSON-758289522 tempest-ServerDiskConfigTestJSON-758289522-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:28:45.826295 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-3a6c0029-dc52-4ac1-a7dd-9557417f269d tempest-ServerDiskConfigTestJSON-758289522 tempest-ServerDiskConfigTestJSON-758289522-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:28:45.826625 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-3a6c0029-dc52-4ac1-a7dd-9557417f269d tempest-ServerDiskConfigTestJSON-758289522 tempest-ServerDiskConfigTestJSON-758289522-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:28:45.827346 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-3a6c0029-dc52-4ac1-a7dd-9557417f269d tempest-ServerDiskConfigTestJSON-758289522 tempest-ServerDiskConfigTestJSON-758289522-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:28:45.827735 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-3a6c0029-dc52-4ac1-a7dd-9557417f269d tempest-ServerDiskConfigTestJSON-758289522 tempest-ServerDiskConfigTestJSON-758289522-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:28:45.843426 n-d-811414-3 nova-conductor[94358]: DEBUG nova.quota [None req-3a6c0029-dc52-4ac1-a7dd-9557417f269d tempest-ServerDiskConfigTestJSON-758289522 tempest-ServerDiskConfigTestJSON-758289522-project] Getting quotas for project 279769e1ff814950a4383f4cee83465d. Resources: {'instances', 'cores', 'ram'} {{(pid=94358) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 21 11:28:45.847891 n-d-811414-3 nova-conductor[94358]: DEBUG nova.quota [None req-3a6c0029-dc52-4ac1-a7dd-9557417f269d tempest-ServerDiskConfigTestJSON-758289522 tempest-ServerDiskConfigTestJSON-758289522-project] Getting quotas for user 3c0823c5815e4e148f06e78cb598625a and project 279769e1ff814950a4383f4cee83465d. Resources: {'instances', 'cores', 'ram'} {{(pid=94358) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 21 11:28:45.858127 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-3a6c0029-dc52-4ac1-a7dd-9557417f269d tempest-ServerDiskConfigTestJSON-758289522 tempest-ServerDiskConfigTestJSON-758289522-project] [instance: 561e22a2-c637-42fb-be8a-853e5d0accbe] Selected host: n-h2-811414-3; Selected node: n-h2-811414-3; Alternates: [('n-h1-811414-3', 'n-h1-811414-3')] {{(pid=94358) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 21 11:28:45.859006 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-3a6c0029-dc52-4ac1-a7dd-9557417f269d tempest-ServerDiskConfigTestJSON-758289522 tempest-ServerDiskConfigTestJSON-758289522-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:28:45.859411 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-3a6c0029-dc52-4ac1-a7dd-9557417f269d tempest-ServerDiskConfigTestJSON-758289522 tempest-ServerDiskConfigTestJSON-758289522-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:28:45.866203 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-3a6c0029-dc52-4ac1-a7dd-9557417f269d tempest-ServerDiskConfigTestJSON-758289522 tempest-ServerDiskConfigTestJSON-758289522-project] [instance: 561e22a2-c637-42fb-be8a-853e5d0accbe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f5cdc3d5-9524-4220-a7fc-ab5606975fdb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94358) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 21 11:28:45.867429 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-3a6c0029-dc52-4ac1-a7dd-9557417f269d tempest-ServerDiskConfigTestJSON-758289522 tempest-ServerDiskConfigTestJSON-758289522-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:28:45.867820 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-3a6c0029-dc52-4ac1-a7dd-9557417f269d tempest-ServerDiskConfigTestJSON-758289522 tempest-ServerDiskConfigTestJSON-758289522-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:28:45.894320 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-3a6c0029-dc52-4ac1-a7dd-9557417f269d tempest-ServerDiskConfigTestJSON-758289522 tempest-ServerDiskConfigTestJSON-758289522-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:28:45.894719 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-3a6c0029-dc52-4ac1-a7dd-9557417f269d tempest-ServerDiskConfigTestJSON-758289522 tempest-ServerDiskConfigTestJSON-758289522-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:28:58.298164 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-b5a378d3-e561-4cd1-a6a2-e19a96e553f4 tempest-ServerDiskConfigTestJSON-758289522 tempest-ServerDiskConfigTestJSON-758289522-project] Targeting cell 6c99d8ec-fb48-48af-b02b-a629a7c2cb6b(cell1) for conductor method migrate_server {{(pid=94357) wrapper /opt/stack/nova/nova/conductor/manager.py:91}} Apr 21 11:28:58.298778 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-b5a378d3-e561-4cd1-a6a2-e19a96e553f4 tempest-ServerDiskConfigTestJSON-758289522 tempest-ServerDiskConfigTestJSON-758289522-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:28:58.299296 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-b5a378d3-e561-4cd1-a6a2-e19a96e553f4 tempest-ServerDiskConfigTestJSON-758289522 tempest-ServerDiskConfigTestJSON-758289522-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:28:58.462792 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.tasks.migrate [None req-b5a378d3-e561-4cd1-a6a2-e19a96e553f4 tempest-ServerDiskConfigTestJSON-758289522 tempest-ServerDiskConfigTestJSON-758289522-project] [instance: 561e22a2-c637-42fb-be8a-853e5d0accbe] Restricting to cell 6c99d8ec-fb48-48af-b02b-a629a7c2cb6b(cell1) while migrating {{(pid=94357) _set_requested_destination_cell /opt/stack/nova/nova/conductor/tasks/migrate.py:208}} Apr 21 11:28:58.795657 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.tasks.migrate [None req-b5a378d3-e561-4cd1-a6a2-e19a96e553f4 tempest-ServerDiskConfigTestJSON-758289522 tempest-ServerDiskConfigTestJSON-758289522-project] Created allocations for migration 24269256-1b89-4887-9adb-014e538c4c39 on 6ea3f8b1-0c53-40ba-ba27-f80f78a284a6 {{(pid=94357) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} Apr 21 11:28:59.004508 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.tasks.migrate [None req-b5a378d3-e561-4cd1-a6a2-e19a96e553f4 tempest-ServerDiskConfigTestJSON-758289522 tempest-ServerDiskConfigTestJSON-758289522-project] [instance: 561e22a2-c637-42fb-be8a-853e5d0accbe] Calling prep_resize with selected host: n-h1-811414-3; Selected node: n-h1-811414-3; Alternates: [Selection(allocation_request='{"allocations": {"6ea3f8b1-0c53-40ba-ba27-f80f78a284a6": {"resources": {"DISK_GB": 1, "MEMORY_MB": 512, "VCPU": 1}}}, "mappings": {"": ["6ea3f8b1-0c53-40ba-ba27-f80f78a284a6"]}}',allocation_request_version='1.35',availability_zone='nova',cell_uuid=6c99d8ec-fb48-48af-b02b-a629a7c2cb6b,compute_node_uuid=6ea3f8b1-0c53-40ba-ba27-f80f78a284a6,limits=SchedulerLimits,nodename='n-h2-811414-3',service_host='n-h2-811414-3')] {{(pid=94357) _execute /opt/stack/nova/nova/conductor/tasks/migrate.py:315}} Apr 21 11:29:37.097131 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-3afdb858-852b-4c5f-b9a3-062c43575b01 tempest-ServerDiskConfigTestJSON-758289522 tempest-ServerDiskConfigTestJSON-758289522-project] Took 0.20 seconds to select destinations for 1 instance(s). {{(pid=94358) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 21 11:29:37.119007 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-3afdb858-852b-4c5f-b9a3-062c43575b01 tempest-ServerDiskConfigTestJSON-758289522 tempest-ServerDiskConfigTestJSON-758289522-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:29:37.119432 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-3afdb858-852b-4c5f-b9a3-062c43575b01 tempest-ServerDiskConfigTestJSON-758289522 tempest-ServerDiskConfigTestJSON-758289522-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:29:37.165164 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-3afdb858-852b-4c5f-b9a3-062c43575b01 tempest-ServerDiskConfigTestJSON-758289522 tempest-ServerDiskConfigTestJSON-758289522-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:29:37.165799 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-3afdb858-852b-4c5f-b9a3-062c43575b01 tempest-ServerDiskConfigTestJSON-758289522 tempest-ServerDiskConfigTestJSON-758289522-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:29:37.166676 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-3afdb858-852b-4c5f-b9a3-062c43575b01 tempest-ServerDiskConfigTestJSON-758289522 tempest-ServerDiskConfigTestJSON-758289522-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:29:37.167152 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-3afdb858-852b-4c5f-b9a3-062c43575b01 tempest-ServerDiskConfigTestJSON-758289522 tempest-ServerDiskConfigTestJSON-758289522-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:29:37.182933 n-d-811414-3 nova-conductor[94358]: DEBUG nova.quota [None req-3afdb858-852b-4c5f-b9a3-062c43575b01 tempest-ServerDiskConfigTestJSON-758289522 tempest-ServerDiskConfigTestJSON-758289522-project] Getting quotas for project 279769e1ff814950a4383f4cee83465d. Resources: {'instances', 'cores', 'ram'} {{(pid=94358) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 21 11:29:37.187455 n-d-811414-3 nova-conductor[94358]: DEBUG nova.quota [None req-3afdb858-852b-4c5f-b9a3-062c43575b01 tempest-ServerDiskConfigTestJSON-758289522 tempest-ServerDiskConfigTestJSON-758289522-project] Getting quotas for user 3c0823c5815e4e148f06e78cb598625a and project 279769e1ff814950a4383f4cee83465d. Resources: {'instances', 'cores', 'ram'} {{(pid=94358) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 21 11:29:37.198701 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-3afdb858-852b-4c5f-b9a3-062c43575b01 tempest-ServerDiskConfigTestJSON-758289522 tempest-ServerDiskConfigTestJSON-758289522-project] [instance: 11efb730-11ce-4916-a839-1c8cff0dd92a] Selected host: n-h1-811414-3; Selected node: n-h1-811414-3; Alternates: [('n-h2-811414-3', 'n-h2-811414-3')] {{(pid=94358) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 21 11:29:37.199611 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-3afdb858-852b-4c5f-b9a3-062c43575b01 tempest-ServerDiskConfigTestJSON-758289522 tempest-ServerDiskConfigTestJSON-758289522-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:29:37.200013 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-3afdb858-852b-4c5f-b9a3-062c43575b01 tempest-ServerDiskConfigTestJSON-758289522 tempest-ServerDiskConfigTestJSON-758289522-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:29:37.206861 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-3afdb858-852b-4c5f-b9a3-062c43575b01 tempest-ServerDiskConfigTestJSON-758289522 tempest-ServerDiskConfigTestJSON-758289522-project] [instance: 11efb730-11ce-4916-a839-1c8cff0dd92a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f5cdc3d5-9524-4220-a7fc-ab5606975fdb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94358) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 21 11:29:37.208169 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-3afdb858-852b-4c5f-b9a3-062c43575b01 tempest-ServerDiskConfigTestJSON-758289522 tempest-ServerDiskConfigTestJSON-758289522-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:29:37.208587 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-3afdb858-852b-4c5f-b9a3-062c43575b01 tempest-ServerDiskConfigTestJSON-758289522 tempest-ServerDiskConfigTestJSON-758289522-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:29:37.236007 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-3afdb858-852b-4c5f-b9a3-062c43575b01 tempest-ServerDiskConfigTestJSON-758289522 tempest-ServerDiskConfigTestJSON-758289522-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:29:37.236459 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-3afdb858-852b-4c5f-b9a3-062c43575b01 tempest-ServerDiskConfigTestJSON-758289522 tempest-ServerDiskConfigTestJSON-758289522-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:29:41.351063 n-d-811414-3 nova-conductor[94357]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6404cb3a-bdc9-481c-93a6-d63501b53d9b] AMQP server on 10.222.0.13:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 21 11:29:42.358922 n-d-811414-3 nova-conductor[94357]: INFO oslo.messaging._drivers.impl_rabbit [-] [6404cb3a-bdc9-481c-93a6-d63501b53d9b] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 44660. Apr 21 11:29:46.121311 n-d-811414-3 nova-conductor[94358]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f60095b5-b68f-459e-af9a-3776dcd48c13] AMQP server on 10.222.0.13:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Apr 21 11:29:47.128541 n-d-811414-3 nova-conductor[94358]: INFO oslo.messaging._drivers.impl_rabbit [-] [f60095b5-b68f-459e-af9a-3776dcd48c13] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 44676. Apr 21 11:29:47.259318 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-281eddff-4a15-44a3-b86b-ac73b125fa9d tempest-ServerDiskConfigTestJSON-758289522 tempest-ServerDiskConfigTestJSON-758289522-project] Targeting cell 6c99d8ec-fb48-48af-b02b-a629a7c2cb6b(cell1) for conductor method migrate_server {{(pid=94357) wrapper /opt/stack/nova/nova/conductor/manager.py:91}} Apr 21 11:29:47.259909 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-281eddff-4a15-44a3-b86b-ac73b125fa9d tempest-ServerDiskConfigTestJSON-758289522 tempest-ServerDiskConfigTestJSON-758289522-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:29:47.260193 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-281eddff-4a15-44a3-b86b-ac73b125fa9d tempest-ServerDiskConfigTestJSON-758289522 tempest-ServerDiskConfigTestJSON-758289522-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:29:47.421376 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.tasks.migrate [None req-281eddff-4a15-44a3-b86b-ac73b125fa9d tempest-ServerDiskConfigTestJSON-758289522 tempest-ServerDiskConfigTestJSON-758289522-project] [instance: 11efb730-11ce-4916-a839-1c8cff0dd92a] Restricting to cell 6c99d8ec-fb48-48af-b02b-a629a7c2cb6b(cell1) while migrating {{(pid=94357) _set_requested_destination_cell /opt/stack/nova/nova/conductor/tasks/migrate.py:208}} Apr 21 11:29:47.690114 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.tasks.migrate [None req-281eddff-4a15-44a3-b86b-ac73b125fa9d tempest-ServerDiskConfigTestJSON-758289522 tempest-ServerDiskConfigTestJSON-758289522-project] Created allocations for migration 73a34915-cd18-4695-94a0-1abfff132224 on 43480f3a-fb09-463e-8326-6927c98a38b4 {{(pid=94357) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} Apr 21 11:29:47.889325 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.tasks.migrate [None req-281eddff-4a15-44a3-b86b-ac73b125fa9d tempest-ServerDiskConfigTestJSON-758289522 tempest-ServerDiskConfigTestJSON-758289522-project] [instance: 11efb730-11ce-4916-a839-1c8cff0dd92a] Calling prep_resize with selected host: n-h2-811414-3; Selected node: n-h2-811414-3; Alternates: [Selection(allocation_request='{"allocations": {"43480f3a-fb09-463e-8326-6927c98a38b4": {"resources": {"DISK_GB": 1, "MEMORY_MB": 512, "VCPU": 1}}}, "mappings": {"": ["43480f3a-fb09-463e-8326-6927c98a38b4"]}}',allocation_request_version='1.35',availability_zone='nova',cell_uuid=6c99d8ec-fb48-48af-b02b-a629a7c2cb6b,compute_node_uuid=43480f3a-fb09-463e-8326-6927c98a38b4,limits=SchedulerLimits,nodename='n-h1-811414-3',service_host='n-h1-811414-3')] {{(pid=94357) _execute /opt/stack/nova/nova/conductor/tasks/migrate.py:315}} Apr 21 11:30:31.507449 n-d-811414-3 nova-conductor[94357]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 21 11:30:38.265571 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-bbe12720-dcb4-4439-b9f8-2a87a650c269 tempest-ServerActionsTestJSON-638016367 tempest-ServerActionsTestJSON-638016367-project] Took 0.24 seconds to select destinations for 1 instance(s). {{(pid=94358) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 21 11:30:38.288181 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-bbe12720-dcb4-4439-b9f8-2a87a650c269 tempest-ServerActionsTestJSON-638016367 tempest-ServerActionsTestJSON-638016367-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:30:38.288614 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-bbe12720-dcb4-4439-b9f8-2a87a650c269 tempest-ServerActionsTestJSON-638016367 tempest-ServerActionsTestJSON-638016367-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:30:38.339564 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-bbe12720-dcb4-4439-b9f8-2a87a650c269 tempest-ServerActionsTestJSON-638016367 tempest-ServerActionsTestJSON-638016367-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:30:38.340089 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-bbe12720-dcb4-4439-b9f8-2a87a650c269 tempest-ServerActionsTestJSON-638016367 tempest-ServerActionsTestJSON-638016367-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:30:38.340729 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-bbe12720-dcb4-4439-b9f8-2a87a650c269 tempest-ServerActionsTestJSON-638016367 tempest-ServerActionsTestJSON-638016367-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:30:38.341117 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-bbe12720-dcb4-4439-b9f8-2a87a650c269 tempest-ServerActionsTestJSON-638016367 tempest-ServerActionsTestJSON-638016367-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:30:38.357267 n-d-811414-3 nova-conductor[94358]: DEBUG nova.quota [None req-bbe12720-dcb4-4439-b9f8-2a87a650c269 tempest-ServerActionsTestJSON-638016367 tempest-ServerActionsTestJSON-638016367-project] Getting quotas for project 9409e02e6d9941348e97863d0c1227ed. Resources: {'instances', 'cores', 'ram'} {{(pid=94358) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 21 11:30:38.361757 n-d-811414-3 nova-conductor[94358]: DEBUG nova.quota [None req-bbe12720-dcb4-4439-b9f8-2a87a650c269 tempest-ServerActionsTestJSON-638016367 tempest-ServerActionsTestJSON-638016367-project] Getting quotas for user aef07b8f8c00482ab5364fcc79aed31f and project 9409e02e6d9941348e97863d0c1227ed. Resources: {'instances', 'cores', 'ram'} {{(pid=94358) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 21 11:30:38.373021 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-bbe12720-dcb4-4439-b9f8-2a87a650c269 tempest-ServerActionsTestJSON-638016367 tempest-ServerActionsTestJSON-638016367-project] [instance: 3d799396-9834-47a8-a8c2-c9bbeb92c385] Selected host: n-h1-811414-3; Selected node: n-h1-811414-3; Alternates: [('n-h2-811414-3', 'n-h2-811414-3')] {{(pid=94358) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 21 11:30:38.373910 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-bbe12720-dcb4-4439-b9f8-2a87a650c269 tempest-ServerActionsTestJSON-638016367 tempest-ServerActionsTestJSON-638016367-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:30:38.374304 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-bbe12720-dcb4-4439-b9f8-2a87a650c269 tempest-ServerActionsTestJSON-638016367 tempest-ServerActionsTestJSON-638016367-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:30:38.380449 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-bbe12720-dcb4-4439-b9f8-2a87a650c269 tempest-ServerActionsTestJSON-638016367 tempest-ServerActionsTestJSON-638016367-project] [instance: 3d799396-9834-47a8-a8c2-c9bbeb92c385] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f5cdc3d5-9524-4220-a7fc-ab5606975fdb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94358) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 21 11:30:38.381645 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-bbe12720-dcb4-4439-b9f8-2a87a650c269 tempest-ServerActionsTestJSON-638016367 tempest-ServerActionsTestJSON-638016367-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:30:38.382038 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-bbe12720-dcb4-4439-b9f8-2a87a650c269 tempest-ServerActionsTestJSON-638016367 tempest-ServerActionsTestJSON-638016367-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:30:38.406170 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-bbe12720-dcb4-4439-b9f8-2a87a650c269 tempest-ServerActionsTestJSON-638016367 tempest-ServerActionsTestJSON-638016367-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:30:38.406569 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-bbe12720-dcb4-4439-b9f8-2a87a650c269 tempest-ServerActionsTestJSON-638016367 tempest-ServerActionsTestJSON-638016367-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:30:51.891087 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-0aca5de2-df78-480a-8065-41f246e67fd4 tempest-ServerActionsTestJSON-638016367 tempest-ServerActionsTestJSON-638016367-project] Targeting cell 6c99d8ec-fb48-48af-b02b-a629a7c2cb6b(cell1) for conductor method migrate_server {{(pid=94357) wrapper /opt/stack/nova/nova/conductor/manager.py:91}} Apr 21 11:30:51.891622 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-0aca5de2-df78-480a-8065-41f246e67fd4 tempest-ServerActionsTestJSON-638016367 tempest-ServerActionsTestJSON-638016367-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:30:51.891964 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-0aca5de2-df78-480a-8065-41f246e67fd4 tempest-ServerActionsTestJSON-638016367 tempest-ServerActionsTestJSON-638016367-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:30:52.168602 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.tasks.migrate [None req-0aca5de2-df78-480a-8065-41f246e67fd4 tempest-ServerActionsTestJSON-638016367 tempest-ServerActionsTestJSON-638016367-project] [instance: 3d799396-9834-47a8-a8c2-c9bbeb92c385] Restricting to cell 6c99d8ec-fb48-48af-b02b-a629a7c2cb6b(cell1) while migrating {{(pid=94357) _set_requested_destination_cell /opt/stack/nova/nova/conductor/tasks/migrate.py:208}} Apr 21 11:30:52.497369 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.tasks.migrate [None req-0aca5de2-df78-480a-8065-41f246e67fd4 tempest-ServerActionsTestJSON-638016367 tempest-ServerActionsTestJSON-638016367-project] Created allocations for migration 46997462-05e7-4922-be3d-1a26bc4cc8c1 on 43480f3a-fb09-463e-8326-6927c98a38b4 {{(pid=94357) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} Apr 21 11:30:52.700270 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.tasks.migrate [None req-0aca5de2-df78-480a-8065-41f246e67fd4 tempest-ServerActionsTestJSON-638016367 tempest-ServerActionsTestJSON-638016367-project] [instance: 3d799396-9834-47a8-a8c2-c9bbeb92c385] Calling prep_resize with selected host: n-h2-811414-3; Selected node: n-h2-811414-3; Alternates: [Selection(allocation_request='{"allocations": {"43480f3a-fb09-463e-8326-6927c98a38b4": {"resources": {"DISK_GB": 1, "MEMORY_MB": 512, "VCPU": 1}}}, "mappings": {"": ["43480f3a-fb09-463e-8326-6927c98a38b4"]}}',allocation_request_version='1.35',availability_zone='nova',cell_uuid=6c99d8ec-fb48-48af-b02b-a629a7c2cb6b,compute_node_uuid=43480f3a-fb09-463e-8326-6927c98a38b4,limits=SchedulerLimits,nodename='n-h1-811414-3',service_host='n-h1-811414-3')] {{(pid=94357) _execute /opt/stack/nova/nova/conductor/tasks/migrate.py:315}} Apr 21 11:31:18.439422 n-d-811414-3 nova-conductor[94358]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 21 11:31:24.808549 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-bdcd29e7-6958-40a9-bc25-e34c474af186 tempest-ServerActionsTestJSON-638016367 tempest-ServerActionsTestJSON-638016367-project] Took 0.21 seconds to select destinations for 1 instance(s). {{(pid=94358) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 21 11:31:24.830531 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-bdcd29e7-6958-40a9-bc25-e34c474af186 tempest-ServerActionsTestJSON-638016367 tempest-ServerActionsTestJSON-638016367-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:31:24.830938 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-bdcd29e7-6958-40a9-bc25-e34c474af186 tempest-ServerActionsTestJSON-638016367 tempest-ServerActionsTestJSON-638016367-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:31:24.872984 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-bdcd29e7-6958-40a9-bc25-e34c474af186 tempest-ServerActionsTestJSON-638016367 tempest-ServerActionsTestJSON-638016367-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:31:24.873321 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-bdcd29e7-6958-40a9-bc25-e34c474af186 tempest-ServerActionsTestJSON-638016367 tempest-ServerActionsTestJSON-638016367-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:31:24.874043 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-bdcd29e7-6958-40a9-bc25-e34c474af186 tempest-ServerActionsTestJSON-638016367 tempest-ServerActionsTestJSON-638016367-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:31:24.874434 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-bdcd29e7-6958-40a9-bc25-e34c474af186 tempest-ServerActionsTestJSON-638016367 tempest-ServerActionsTestJSON-638016367-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:31:24.889592 n-d-811414-3 nova-conductor[94358]: DEBUG nova.quota [None req-bdcd29e7-6958-40a9-bc25-e34c474af186 tempest-ServerActionsTestJSON-638016367 tempest-ServerActionsTestJSON-638016367-project] Getting quotas for project 9409e02e6d9941348e97863d0c1227ed. Resources: {'instances', 'cores', 'ram'} {{(pid=94358) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 21 11:31:24.894074 n-d-811414-3 nova-conductor[94358]: DEBUG nova.quota [None req-bdcd29e7-6958-40a9-bc25-e34c474af186 tempest-ServerActionsTestJSON-638016367 tempest-ServerActionsTestJSON-638016367-project] Getting quotas for user aef07b8f8c00482ab5364fcc79aed31f and project 9409e02e6d9941348e97863d0c1227ed. Resources: {'instances', 'cores', 'ram'} {{(pid=94358) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 21 11:31:24.905185 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-bdcd29e7-6958-40a9-bc25-e34c474af186 tempest-ServerActionsTestJSON-638016367 tempest-ServerActionsTestJSON-638016367-project] [instance: 94c9c39c-887a-4843-8aa6-0118c8ea044c] Selected host: n-h2-811414-3; Selected node: n-h2-811414-3; Alternates: [('n-h1-811414-3', 'n-h1-811414-3')] {{(pid=94358) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 21 11:31:24.906062 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-bdcd29e7-6958-40a9-bc25-e34c474af186 tempest-ServerActionsTestJSON-638016367 tempest-ServerActionsTestJSON-638016367-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:31:24.906455 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-bdcd29e7-6958-40a9-bc25-e34c474af186 tempest-ServerActionsTestJSON-638016367 tempest-ServerActionsTestJSON-638016367-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:31:24.912709 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-bdcd29e7-6958-40a9-bc25-e34c474af186 tempest-ServerActionsTestJSON-638016367 tempest-ServerActionsTestJSON-638016367-project] [instance: 94c9c39c-887a-4843-8aa6-0118c8ea044c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f5cdc3d5-9524-4220-a7fc-ab5606975fdb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94358) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 21 11:31:24.913910 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-bdcd29e7-6958-40a9-bc25-e34c474af186 tempest-ServerActionsTestJSON-638016367 tempest-ServerActionsTestJSON-638016367-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:31:24.914304 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-bdcd29e7-6958-40a9-bc25-e34c474af186 tempest-ServerActionsTestJSON-638016367 tempest-ServerActionsTestJSON-638016367-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:31:24.940211 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-bdcd29e7-6958-40a9-bc25-e34c474af186 tempest-ServerActionsTestJSON-638016367 tempest-ServerActionsTestJSON-638016367-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:31:24.940653 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-bdcd29e7-6958-40a9-bc25-e34c474af186 tempest-ServerActionsTestJSON-638016367 tempest-ServerActionsTestJSON-638016367-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:32:09.853690 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-8f573e70-c5e0-4dec-b586-0c2c62abb825 tempest-ServerActionsTestJSON-638016367 tempest-ServerActionsTestJSON-638016367-project] Targeting cell 6c99d8ec-fb48-48af-b02b-a629a7c2cb6b(cell1) for conductor method migrate_server {{(pid=94357) wrapper /opt/stack/nova/nova/conductor/manager.py:91}} Apr 21 11:32:09.854260 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-8f573e70-c5e0-4dec-b586-0c2c62abb825 tempest-ServerActionsTestJSON-638016367 tempest-ServerActionsTestJSON-638016367-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:32:09.854675 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-8f573e70-c5e0-4dec-b586-0c2c62abb825 tempest-ServerActionsTestJSON-638016367 tempest-ServerActionsTestJSON-638016367-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:32:10.016530 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.tasks.migrate [None req-8f573e70-c5e0-4dec-b586-0c2c62abb825 tempest-ServerActionsTestJSON-638016367 tempest-ServerActionsTestJSON-638016367-project] [instance: 94c9c39c-887a-4843-8aa6-0118c8ea044c] Restricting to cell 6c99d8ec-fb48-48af-b02b-a629a7c2cb6b(cell1) while migrating {{(pid=94357) _set_requested_destination_cell /opt/stack/nova/nova/conductor/tasks/migrate.py:208}} Apr 21 11:32:10.276301 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.tasks.migrate [None req-8f573e70-c5e0-4dec-b586-0c2c62abb825 tempest-ServerActionsTestJSON-638016367 tempest-ServerActionsTestJSON-638016367-project] Created allocations for migration 8fd85671-c664-4856-b484-1b8f2a5a7f9e on 6ea3f8b1-0c53-40ba-ba27-f80f78a284a6 {{(pid=94357) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} Apr 21 11:32:10.476040 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.tasks.migrate [None req-8f573e70-c5e0-4dec-b586-0c2c62abb825 tempest-ServerActionsTestJSON-638016367 tempest-ServerActionsTestJSON-638016367-project] [instance: 94c9c39c-887a-4843-8aa6-0118c8ea044c] Calling prep_resize with selected host: n-h1-811414-3; Selected node: n-h1-811414-3; Alternates: [Selection(allocation_request='{"allocations": {"6ea3f8b1-0c53-40ba-ba27-f80f78a284a6": {"resources": {"DISK_GB": 1, "MEMORY_MB": 512, "VCPU": 1}}}, "mappings": {"": ["6ea3f8b1-0c53-40ba-ba27-f80f78a284a6"]}}',allocation_request_version='1.35',availability_zone='nova',cell_uuid=6c99d8ec-fb48-48af-b02b-a629a7c2cb6b,compute_node_uuid=6ea3f8b1-0c53-40ba-ba27-f80f78a284a6,limits=SchedulerLimits,nodename='n-h2-811414-3',service_host='n-h2-811414-3')] {{(pid=94357) _execute /opt/stack/nova/nova/conductor/tasks/migrate.py:315}} Apr 21 11:32:28.920175 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-e8672247-87a0-4197-bd91-be8cd2f2235b tempest-ServerActionsTestJSON-638016367 tempest-ServerActionsTestJSON-638016367-project] Took 0.21 seconds to select destinations for 1 instance(s). {{(pid=94358) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 21 11:32:28.942351 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-e8672247-87a0-4197-bd91-be8cd2f2235b tempest-ServerActionsTestJSON-638016367 tempest-ServerActionsTestJSON-638016367-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:32:28.942752 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-e8672247-87a0-4197-bd91-be8cd2f2235b tempest-ServerActionsTestJSON-638016367 tempest-ServerActionsTestJSON-638016367-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:32:28.986648 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-e8672247-87a0-4197-bd91-be8cd2f2235b tempest-ServerActionsTestJSON-638016367 tempest-ServerActionsTestJSON-638016367-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:32:28.987047 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-e8672247-87a0-4197-bd91-be8cd2f2235b tempest-ServerActionsTestJSON-638016367 tempest-ServerActionsTestJSON-638016367-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:32:28.987769 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-e8672247-87a0-4197-bd91-be8cd2f2235b tempest-ServerActionsTestJSON-638016367 tempest-ServerActionsTestJSON-638016367-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:32:28.988160 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-e8672247-87a0-4197-bd91-be8cd2f2235b tempest-ServerActionsTestJSON-638016367 tempest-ServerActionsTestJSON-638016367-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:32:29.003387 n-d-811414-3 nova-conductor[94358]: DEBUG nova.quota [None req-e8672247-87a0-4197-bd91-be8cd2f2235b tempest-ServerActionsTestJSON-638016367 tempest-ServerActionsTestJSON-638016367-project] Getting quotas for project 9409e02e6d9941348e97863d0c1227ed. Resources: {'instances', 'cores', 'ram'} {{(pid=94358) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 21 11:32:29.007846 n-d-811414-3 nova-conductor[94358]: DEBUG nova.quota [None req-e8672247-87a0-4197-bd91-be8cd2f2235b tempest-ServerActionsTestJSON-638016367 tempest-ServerActionsTestJSON-638016367-project] Getting quotas for user aef07b8f8c00482ab5364fcc79aed31f and project 9409e02e6d9941348e97863d0c1227ed. Resources: {'instances', 'cores', 'ram'} {{(pid=94358) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 21 11:32:29.018181 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-e8672247-87a0-4197-bd91-be8cd2f2235b tempest-ServerActionsTestJSON-638016367 tempest-ServerActionsTestJSON-638016367-project] [instance: f85a977c-98eb-4e4e-b910-e5aae33ec276] Selected host: n-h1-811414-3; Selected node: n-h1-811414-3; Alternates: [('n-h2-811414-3', 'n-h2-811414-3')] {{(pid=94358) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 21 11:32:29.019041 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-e8672247-87a0-4197-bd91-be8cd2f2235b tempest-ServerActionsTestJSON-638016367 tempest-ServerActionsTestJSON-638016367-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:32:29.019436 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-e8672247-87a0-4197-bd91-be8cd2f2235b tempest-ServerActionsTestJSON-638016367 tempest-ServerActionsTestJSON-638016367-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:32:29.025292 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-e8672247-87a0-4197-bd91-be8cd2f2235b tempest-ServerActionsTestJSON-638016367 tempest-ServerActionsTestJSON-638016367-project] [instance: f85a977c-98eb-4e4e-b910-e5aae33ec276] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f5cdc3d5-9524-4220-a7fc-ab5606975fdb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94358) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 21 11:32:29.026417 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-e8672247-87a0-4197-bd91-be8cd2f2235b tempest-ServerActionsTestJSON-638016367 tempest-ServerActionsTestJSON-638016367-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:32:29.026816 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-e8672247-87a0-4197-bd91-be8cd2f2235b tempest-ServerActionsTestJSON-638016367 tempest-ServerActionsTestJSON-638016367-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:32:29.053922 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-e8672247-87a0-4197-bd91-be8cd2f2235b tempest-ServerActionsTestJSON-638016367 tempest-ServerActionsTestJSON-638016367-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:32:29.054386 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-e8672247-87a0-4197-bd91-be8cd2f2235b tempest-ServerActionsTestJSON-638016367 tempest-ServerActionsTestJSON-638016367-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:32:39.361272 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-33086f2f-e42b-4b9a-a200-ff4d2e170e32 tempest-ServerActionsTestJSON-638016367 tempest-ServerActionsTestJSON-638016367-project] Targeting cell 6c99d8ec-fb48-48af-b02b-a629a7c2cb6b(cell1) for conductor method migrate_server {{(pid=94357) wrapper /opt/stack/nova/nova/conductor/manager.py:91}} Apr 21 11:32:39.362736 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-33086f2f-e42b-4b9a-a200-ff4d2e170e32 tempest-ServerActionsTestJSON-638016367 tempest-ServerActionsTestJSON-638016367-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:32:39.363404 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-33086f2f-e42b-4b9a-a200-ff4d2e170e32 tempest-ServerActionsTestJSON-638016367 tempest-ServerActionsTestJSON-638016367-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:32:39.709935 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.tasks.migrate [None req-33086f2f-e42b-4b9a-a200-ff4d2e170e32 tempest-ServerActionsTestJSON-638016367 tempest-ServerActionsTestJSON-638016367-project] [instance: f85a977c-98eb-4e4e-b910-e5aae33ec276] Restricting to cell 6c99d8ec-fb48-48af-b02b-a629a7c2cb6b(cell1) while migrating {{(pid=94357) _set_requested_destination_cell /opt/stack/nova/nova/conductor/tasks/migrate.py:208}} Apr 21 11:32:40.008881 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.tasks.migrate [None req-33086f2f-e42b-4b9a-a200-ff4d2e170e32 tempest-ServerActionsTestJSON-638016367 tempest-ServerActionsTestJSON-638016367-project] Created allocations for migration e49180cc-dc4c-422c-b59b-ecd8b3897344 on 43480f3a-fb09-463e-8326-6927c98a38b4 {{(pid=94357) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} Apr 21 11:32:40.348319 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.tasks.migrate [None req-33086f2f-e42b-4b9a-a200-ff4d2e170e32 tempest-ServerActionsTestJSON-638016367 tempest-ServerActionsTestJSON-638016367-project] [instance: f85a977c-98eb-4e4e-b910-e5aae33ec276] Calling prep_resize with selected host: n-h2-811414-3; Selected node: n-h2-811414-3; Alternates: [Selection(allocation_request='{"allocations": {"43480f3a-fb09-463e-8326-6927c98a38b4": {"resources": {"DISK_GB": 1, "MEMORY_MB": 512, "VCPU": 1}}}, "mappings": {"": ["43480f3a-fb09-463e-8326-6927c98a38b4"]}}',allocation_request_version='1.35',availability_zone='nova',cell_uuid=6c99d8ec-fb48-48af-b02b-a629a7c2cb6b,compute_node_uuid=43480f3a-fb09-463e-8326-6927c98a38b4,limits=SchedulerLimits,nodename='n-h1-811414-3',service_host='n-h1-811414-3')] {{(pid=94357) _execute /opt/stack/nova/nova/conductor/tasks/migrate.py:315}} Apr 21 11:32:42.359467 n-d-811414-3 nova-conductor[94357]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6404cb3a-bdc9-481c-93a6-d63501b53d9b] AMQP server on 10.222.0.13:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Apr 21 11:32:43.367718 n-d-811414-3 nova-conductor[94357]: INFO oslo.messaging._drivers.impl_rabbit [-] [6404cb3a-bdc9-481c-93a6-d63501b53d9b] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 45312. Apr 21 11:32:47.129410 n-d-811414-3 nova-conductor[94358]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f60095b5-b68f-459e-af9a-3776dcd48c13] AMQP server on 10.222.0.13:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Apr 21 11:32:48.137175 n-d-811414-3 nova-conductor[94358]: INFO oslo.messaging._drivers.impl_rabbit [-] [f60095b5-b68f-459e-af9a-3776dcd48c13] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 45320. Apr 21 11:33:32.373345 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-0ee0a370-f8b6-442c-8735-abcbda974a25 tempest-ServerActionsTestJSON-638016367 tempest-ServerActionsTestJSON-638016367-project] Took 0.31 seconds to select destinations for 1 instance(s). {{(pid=94358) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 21 11:33:32.396026 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-0ee0a370-f8b6-442c-8735-abcbda974a25 tempest-ServerActionsTestJSON-638016367 tempest-ServerActionsTestJSON-638016367-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:33:32.396457 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-0ee0a370-f8b6-442c-8735-abcbda974a25 tempest-ServerActionsTestJSON-638016367 tempest-ServerActionsTestJSON-638016367-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:33:32.439889 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-0ee0a370-f8b6-442c-8735-abcbda974a25 tempest-ServerActionsTestJSON-638016367 tempest-ServerActionsTestJSON-638016367-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:33:32.440290 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-0ee0a370-f8b6-442c-8735-abcbda974a25 tempest-ServerActionsTestJSON-638016367 tempest-ServerActionsTestJSON-638016367-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:33:32.441033 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-0ee0a370-f8b6-442c-8735-abcbda974a25 tempest-ServerActionsTestJSON-638016367 tempest-ServerActionsTestJSON-638016367-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:33:32.441421 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-0ee0a370-f8b6-442c-8735-abcbda974a25 tempest-ServerActionsTestJSON-638016367 tempest-ServerActionsTestJSON-638016367-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:33:32.456900 n-d-811414-3 nova-conductor[94358]: DEBUG nova.quota [None req-0ee0a370-f8b6-442c-8735-abcbda974a25 tempest-ServerActionsTestJSON-638016367 tempest-ServerActionsTestJSON-638016367-project] Getting quotas for project 9409e02e6d9941348e97863d0c1227ed. Resources: {'instances', 'cores', 'ram'} {{(pid=94358) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 21 11:33:32.461364 n-d-811414-3 nova-conductor[94358]: DEBUG nova.quota [None req-0ee0a370-f8b6-442c-8735-abcbda974a25 tempest-ServerActionsTestJSON-638016367 tempest-ServerActionsTestJSON-638016367-project] Getting quotas for user aef07b8f8c00482ab5364fcc79aed31f and project 9409e02e6d9941348e97863d0c1227ed. Resources: {'instances', 'cores', 'ram'} {{(pid=94358) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 21 11:33:32.471636 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-0ee0a370-f8b6-442c-8735-abcbda974a25 tempest-ServerActionsTestJSON-638016367 tempest-ServerActionsTestJSON-638016367-project] [instance: ef5fc714-2564-4aa7-9542-d0d266287174] Selected host: n-h1-811414-3; Selected node: n-h1-811414-3; Alternates: [('n-h2-811414-3', 'n-h2-811414-3')] {{(pid=94358) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 21 11:33:32.472539 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-0ee0a370-f8b6-442c-8735-abcbda974a25 tempest-ServerActionsTestJSON-638016367 tempest-ServerActionsTestJSON-638016367-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:33:32.472932 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-0ee0a370-f8b6-442c-8735-abcbda974a25 tempest-ServerActionsTestJSON-638016367 tempest-ServerActionsTestJSON-638016367-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:33:32.479267 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-0ee0a370-f8b6-442c-8735-abcbda974a25 tempest-ServerActionsTestJSON-638016367 tempest-ServerActionsTestJSON-638016367-project] [instance: ef5fc714-2564-4aa7-9542-d0d266287174] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f5cdc3d5-9524-4220-a7fc-ab5606975fdb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94358) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 21 11:33:32.480454 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-0ee0a370-f8b6-442c-8735-abcbda974a25 tempest-ServerActionsTestJSON-638016367 tempest-ServerActionsTestJSON-638016367-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:33:32.480856 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-0ee0a370-f8b6-442c-8735-abcbda974a25 tempest-ServerActionsTestJSON-638016367 tempest-ServerActionsTestJSON-638016367-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:33:32.508111 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-0ee0a370-f8b6-442c-8735-abcbda974a25 tempest-ServerActionsTestJSON-638016367 tempest-ServerActionsTestJSON-638016367-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:33:32.508570 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-0ee0a370-f8b6-442c-8735-abcbda974a25 tempest-ServerActionsTestJSON-638016367 tempest-ServerActionsTestJSON-638016367-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:33:51.516277 n-d-811414-3 nova-conductor[94357]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 21 11:33:53.768984 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-b1e02553-7e6b-424e-907a-30aab68e3ed3 tempest-ServerActionsTestJSON-638016367 tempest-ServerActionsTestJSON-638016367-project] Targeting cell 6c99d8ec-fb48-48af-b02b-a629a7c2cb6b(cell1) for conductor method migrate_server {{(pid=94357) wrapper /opt/stack/nova/nova/conductor/manager.py:91}} Apr 21 11:33:53.769554 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-b1e02553-7e6b-424e-907a-30aab68e3ed3 tempest-ServerActionsTestJSON-638016367 tempest-ServerActionsTestJSON-638016367-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:33:53.769854 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-b1e02553-7e6b-424e-907a-30aab68e3ed3 tempest-ServerActionsTestJSON-638016367 tempest-ServerActionsTestJSON-638016367-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:33:53.933182 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.tasks.migrate [None req-b1e02553-7e6b-424e-907a-30aab68e3ed3 tempest-ServerActionsTestJSON-638016367 tempest-ServerActionsTestJSON-638016367-project] [instance: ef5fc714-2564-4aa7-9542-d0d266287174] Restricting to cell 6c99d8ec-fb48-48af-b02b-a629a7c2cb6b(cell1) while migrating {{(pid=94357) _set_requested_destination_cell /opt/stack/nova/nova/conductor/tasks/migrate.py:208}} Apr 21 11:33:54.244713 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.tasks.migrate [None req-b1e02553-7e6b-424e-907a-30aab68e3ed3 tempest-ServerActionsTestJSON-638016367 tempest-ServerActionsTestJSON-638016367-project] Created allocations for migration 58d6f07c-3d95-4a44-af58-503a357c20dc on 43480f3a-fb09-463e-8326-6927c98a38b4 {{(pid=94357) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} Apr 21 11:33:54.444754 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.tasks.migrate [None req-b1e02553-7e6b-424e-907a-30aab68e3ed3 tempest-ServerActionsTestJSON-638016367 tempest-ServerActionsTestJSON-638016367-project] [instance: ef5fc714-2564-4aa7-9542-d0d266287174] Calling prep_resize with selected host: n-h2-811414-3; Selected node: n-h2-811414-3; Alternates: [Selection(allocation_request='{"allocations": {"43480f3a-fb09-463e-8326-6927c98a38b4": {"resources": {"DISK_GB": 1, "MEMORY_MB": 512, "VCPU": 1}}}, "mappings": {"": ["43480f3a-fb09-463e-8326-6927c98a38b4"]}}',allocation_request_version='1.35',availability_zone='nova',cell_uuid=6c99d8ec-fb48-48af-b02b-a629a7c2cb6b,compute_node_uuid=43480f3a-fb09-463e-8326-6927c98a38b4,limits=SchedulerLimits,nodename='n-h1-811414-3',service_host='n-h1-811414-3')] {{(pid=94357) _execute /opt/stack/nova/nova/conductor/tasks/migrate.py:315}} Apr 21 11:34:38.448423 n-d-811414-3 nova-conductor[94358]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 21 11:35:03.699110 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-a0016485-c021-4c0a-b183-38166af8f273 tempest-ServersNegativeTestJSON-1374916834 tempest-ServersNegativeTestJSON-1374916834-project] Took 0.22 seconds to select destinations for 1 instance(s). {{(pid=94358) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 21 11:35:03.721625 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-a0016485-c021-4c0a-b183-38166af8f273 tempest-ServersNegativeTestJSON-1374916834 tempest-ServersNegativeTestJSON-1374916834-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:35:03.722031 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-a0016485-c021-4c0a-b183-38166af8f273 tempest-ServersNegativeTestJSON-1374916834 tempest-ServersNegativeTestJSON-1374916834-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:35:03.775335 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-a0016485-c021-4c0a-b183-38166af8f273 tempest-ServersNegativeTestJSON-1374916834 tempest-ServersNegativeTestJSON-1374916834-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:35:03.775742 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-a0016485-c021-4c0a-b183-38166af8f273 tempest-ServersNegativeTestJSON-1374916834 tempest-ServersNegativeTestJSON-1374916834-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:35:03.776499 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-a0016485-c021-4c0a-b183-38166af8f273 tempest-ServersNegativeTestJSON-1374916834 tempest-ServersNegativeTestJSON-1374916834-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:35:03.776894 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-a0016485-c021-4c0a-b183-38166af8f273 tempest-ServersNegativeTestJSON-1374916834 tempest-ServersNegativeTestJSON-1374916834-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:35:03.792463 n-d-811414-3 nova-conductor[94358]: DEBUG nova.quota [None req-a0016485-c021-4c0a-b183-38166af8f273 tempest-ServersNegativeTestJSON-1374916834 tempest-ServersNegativeTestJSON-1374916834-project] Getting quotas for project 4e4e2bf936de47bbb86d2599b610a9ae. Resources: {'instances', 'cores', 'ram'} {{(pid=94358) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 21 11:35:03.796968 n-d-811414-3 nova-conductor[94358]: DEBUG nova.quota [None req-a0016485-c021-4c0a-b183-38166af8f273 tempest-ServersNegativeTestJSON-1374916834 tempest-ServersNegativeTestJSON-1374916834-project] Getting quotas for user 242ed9632092419ebdfee52c83ada6d4 and project 4e4e2bf936de47bbb86d2599b610a9ae. Resources: {'instances', 'cores', 'ram'} {{(pid=94358) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 21 11:35:03.807969 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-a0016485-c021-4c0a-b183-38166af8f273 tempest-ServersNegativeTestJSON-1374916834 tempest-ServersNegativeTestJSON-1374916834-project] [instance: ef57992e-5fa8-4c37-afdc-99f4a1c18c9f] Selected host: n-h2-811414-3; Selected node: n-h2-811414-3; Alternates: [('n-h1-811414-3', 'n-h1-811414-3')] {{(pid=94358) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 21 11:35:03.808890 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-a0016485-c021-4c0a-b183-38166af8f273 tempest-ServersNegativeTestJSON-1374916834 tempest-ServersNegativeTestJSON-1374916834-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:35:03.809281 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-a0016485-c021-4c0a-b183-38166af8f273 tempest-ServersNegativeTestJSON-1374916834 tempest-ServersNegativeTestJSON-1374916834-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:35:03.815742 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-a0016485-c021-4c0a-b183-38166af8f273 tempest-ServersNegativeTestJSON-1374916834 tempest-ServersNegativeTestJSON-1374916834-project] [instance: ef57992e-5fa8-4c37-afdc-99f4a1c18c9f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f5cdc3d5-9524-4220-a7fc-ab5606975fdb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94358) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 21 11:35:03.816935 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-a0016485-c021-4c0a-b183-38166af8f273 tempest-ServersNegativeTestJSON-1374916834 tempest-ServersNegativeTestJSON-1374916834-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:35:03.817349 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-a0016485-c021-4c0a-b183-38166af8f273 tempest-ServersNegativeTestJSON-1374916834 tempest-ServersNegativeTestJSON-1374916834-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:35:03.843862 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-a0016485-c021-4c0a-b183-38166af8f273 tempest-ServersNegativeTestJSON-1374916834 tempest-ServersNegativeTestJSON-1374916834-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:35:03.844263 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-a0016485-c021-4c0a-b183-38166af8f273 tempest-ServersNegativeTestJSON-1374916834 tempest-ServersNegativeTestJSON-1374916834-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:35:16.069842 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-ae5065a7-13ff-418f-be5a-9e832a0378bd tempest-ServersNegativeTestJSON-1374916834 tempest-ServersNegativeTestJSON-1374916834-project] Took 0.20 seconds to select destinations for 1 instance(s). {{(pid=94357) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 21 11:35:16.091672 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-ae5065a7-13ff-418f-be5a-9e832a0378bd tempest-ServersNegativeTestJSON-1374916834 tempest-ServersNegativeTestJSON-1374916834-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:35:16.092074 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-ae5065a7-13ff-418f-be5a-9e832a0378bd tempest-ServersNegativeTestJSON-1374916834 tempest-ServersNegativeTestJSON-1374916834-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:35:16.135908 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-ae5065a7-13ff-418f-be5a-9e832a0378bd tempest-ServersNegativeTestJSON-1374916834 tempest-ServersNegativeTestJSON-1374916834-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:35:16.136301 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-ae5065a7-13ff-418f-be5a-9e832a0378bd tempest-ServersNegativeTestJSON-1374916834 tempest-ServersNegativeTestJSON-1374916834-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:35:16.137103 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-ae5065a7-13ff-418f-be5a-9e832a0378bd tempest-ServersNegativeTestJSON-1374916834 tempest-ServersNegativeTestJSON-1374916834-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:35:16.137487 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-ae5065a7-13ff-418f-be5a-9e832a0378bd tempest-ServersNegativeTestJSON-1374916834 tempest-ServersNegativeTestJSON-1374916834-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:35:16.152841 n-d-811414-3 nova-conductor[94357]: DEBUG nova.quota [None req-ae5065a7-13ff-418f-be5a-9e832a0378bd tempest-ServersNegativeTestJSON-1374916834 tempest-ServersNegativeTestJSON-1374916834-project] Getting quotas for project 4e4e2bf936de47bbb86d2599b610a9ae. Resources: {'instances', 'cores', 'ram'} {{(pid=94357) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 21 11:35:16.157220 n-d-811414-3 nova-conductor[94357]: DEBUG nova.quota [None req-ae5065a7-13ff-418f-be5a-9e832a0378bd tempest-ServersNegativeTestJSON-1374916834 tempest-ServersNegativeTestJSON-1374916834-project] Getting quotas for user 242ed9632092419ebdfee52c83ada6d4 and project 4e4e2bf936de47bbb86d2599b610a9ae. Resources: {'instances', 'cores', 'ram'} {{(pid=94357) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 21 11:35:16.168053 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-ae5065a7-13ff-418f-be5a-9e832a0378bd tempest-ServersNegativeTestJSON-1374916834 tempest-ServersNegativeTestJSON-1374916834-project] [instance: f3f864f4-4ef0-4494-a5f4-7a49479be459] Selected host: n-h1-811414-3; Selected node: n-h1-811414-3; Alternates: [('n-h2-811414-3', 'n-h2-811414-3')] {{(pid=94357) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 21 11:35:16.168973 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-ae5065a7-13ff-418f-be5a-9e832a0378bd tempest-ServersNegativeTestJSON-1374916834 tempest-ServersNegativeTestJSON-1374916834-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:35:16.169363 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-ae5065a7-13ff-418f-be5a-9e832a0378bd tempest-ServersNegativeTestJSON-1374916834 tempest-ServersNegativeTestJSON-1374916834-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:35:16.176112 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-ae5065a7-13ff-418f-be5a-9e832a0378bd tempest-ServersNegativeTestJSON-1374916834 tempest-ServersNegativeTestJSON-1374916834-project] [instance: f3f864f4-4ef0-4494-a5f4-7a49479be459] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f5cdc3d5-9524-4220-a7fc-ab5606975fdb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94357) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 21 11:35:16.177374 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-ae5065a7-13ff-418f-be5a-9e832a0378bd tempest-ServersNegativeTestJSON-1374916834 tempest-ServersNegativeTestJSON-1374916834-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:35:16.177769 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-ae5065a7-13ff-418f-be5a-9e832a0378bd tempest-ServersNegativeTestJSON-1374916834 tempest-ServersNegativeTestJSON-1374916834-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:35:16.202995 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-ae5065a7-13ff-418f-be5a-9e832a0378bd tempest-ServersNegativeTestJSON-1374916834 tempest-ServersNegativeTestJSON-1374916834-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:35:16.203415 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-ae5065a7-13ff-418f-be5a-9e832a0378bd tempest-ServersNegativeTestJSON-1374916834 tempest-ServersNegativeTestJSON-1374916834-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:35:43.368889 n-d-811414-3 nova-conductor[94357]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6404cb3a-bdc9-481c-93a6-d63501b53d9b] AMQP server on 10.222.0.13:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 21 11:35:44.378477 n-d-811414-3 nova-conductor[94357]: INFO oslo.messaging._drivers.impl_rabbit [-] [6404cb3a-bdc9-481c-93a6-d63501b53d9b] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 46002. Apr 21 11:35:48.139563 n-d-811414-3 nova-conductor[94358]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f60095b5-b68f-459e-af9a-3776dcd48c13] AMQP server on 10.222.0.13:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Apr 21 11:35:49.148345 n-d-811414-3 nova-conductor[94358]: INFO oslo.messaging._drivers.impl_rabbit [-] [f60095b5-b68f-459e-af9a-3776dcd48c13] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 46074. Apr 21 11:36:12.081843 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-42cb7a1e-5b99-4f97-8838-9303a7d1f569 tempest-TestEncryptedCinderVolumes-1253539045 tempest-TestEncryptedCinderVolumes-1253539045-project] Took 0.21 seconds to select destinations for 1 instance(s). {{(pid=94358) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 21 11:36:12.103345 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-42cb7a1e-5b99-4f97-8838-9303a7d1f569 tempest-TestEncryptedCinderVolumes-1253539045 tempest-TestEncryptedCinderVolumes-1253539045-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:36:12.103749 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-42cb7a1e-5b99-4f97-8838-9303a7d1f569 tempest-TestEncryptedCinderVolumes-1253539045 tempest-TestEncryptedCinderVolumes-1253539045-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:36:12.153535 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-42cb7a1e-5b99-4f97-8838-9303a7d1f569 tempest-TestEncryptedCinderVolumes-1253539045 tempest-TestEncryptedCinderVolumes-1253539045-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:36:12.153942 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-42cb7a1e-5b99-4f97-8838-9303a7d1f569 tempest-TestEncryptedCinderVolumes-1253539045 tempest-TestEncryptedCinderVolumes-1253539045-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:36:12.154671 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-42cb7a1e-5b99-4f97-8838-9303a7d1f569 tempest-TestEncryptedCinderVolumes-1253539045 tempest-TestEncryptedCinderVolumes-1253539045-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:36:12.155066 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-42cb7a1e-5b99-4f97-8838-9303a7d1f569 tempest-TestEncryptedCinderVolumes-1253539045 tempest-TestEncryptedCinderVolumes-1253539045-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:36:12.170437 n-d-811414-3 nova-conductor[94358]: DEBUG nova.quota [None req-42cb7a1e-5b99-4f97-8838-9303a7d1f569 tempest-TestEncryptedCinderVolumes-1253539045 tempest-TestEncryptedCinderVolumes-1253539045-project] Getting quotas for project 3dc8c28379b34a6aa042a975027a9dac. Resources: {'instances', 'cores', 'ram'} {{(pid=94358) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 21 11:36:12.176034 n-d-811414-3 nova-conductor[94358]: DEBUG nova.quota [None req-42cb7a1e-5b99-4f97-8838-9303a7d1f569 tempest-TestEncryptedCinderVolumes-1253539045 tempest-TestEncryptedCinderVolumes-1253539045-project] Getting quotas for user 90c4bb2d63c54e0aa0405267f3e91205 and project 3dc8c28379b34a6aa042a975027a9dac. Resources: {'instances', 'cores', 'ram'} {{(pid=94358) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 21 11:36:12.186755 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-42cb7a1e-5b99-4f97-8838-9303a7d1f569 tempest-TestEncryptedCinderVolumes-1253539045 tempest-TestEncryptedCinderVolumes-1253539045-project] [instance: 423aff1f-1265-496d-9575-48801dc91fab] Selected host: n-h1-811414-3; Selected node: n-h1-811414-3; Alternates: [('n-h2-811414-3', 'n-h2-811414-3')] {{(pid=94358) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 21 11:36:12.188250 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-42cb7a1e-5b99-4f97-8838-9303a7d1f569 tempest-TestEncryptedCinderVolumes-1253539045 tempest-TestEncryptedCinderVolumes-1253539045-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:36:12.188689 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-42cb7a1e-5b99-4f97-8838-9303a7d1f569 tempest-TestEncryptedCinderVolumes-1253539045 tempest-TestEncryptedCinderVolumes-1253539045-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:36:12.194945 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-42cb7a1e-5b99-4f97-8838-9303a7d1f569 tempest-TestEncryptedCinderVolumes-1253539045 tempest-TestEncryptedCinderVolumes-1253539045-project] [instance: 423aff1f-1265-496d-9575-48801dc91fab] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f5cdc3d5-9524-4220-a7fc-ab5606975fdb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94358) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 21 11:36:12.196509 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-42cb7a1e-5b99-4f97-8838-9303a7d1f569 tempest-TestEncryptedCinderVolumes-1253539045 tempest-TestEncryptedCinderVolumes-1253539045-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:36:12.197051 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-42cb7a1e-5b99-4f97-8838-9303a7d1f569 tempest-TestEncryptedCinderVolumes-1253539045 tempest-TestEncryptedCinderVolumes-1253539045-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:36:12.223164 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-42cb7a1e-5b99-4f97-8838-9303a7d1f569 tempest-TestEncryptedCinderVolumes-1253539045 tempest-TestEncryptedCinderVolumes-1253539045-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:36:12.223568 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-42cb7a1e-5b99-4f97-8838-9303a7d1f569 tempest-TestEncryptedCinderVolumes-1253539045 tempest-TestEncryptedCinderVolumes-1253539045-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:36:40.687405 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-ac8a3b34-39df-4edc-9389-e1fa646a905d tempest-TestEncryptedCinderVolumes-1253539045 tempest-TestEncryptedCinderVolumes-1253539045-project] Took 0.20 seconds to select destinations for 1 instance(s). {{(pid=94357) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 21 11:36:40.709626 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-ac8a3b34-39df-4edc-9389-e1fa646a905d tempest-TestEncryptedCinderVolumes-1253539045 tempest-TestEncryptedCinderVolumes-1253539045-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:36:40.710028 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-ac8a3b34-39df-4edc-9389-e1fa646a905d tempest-TestEncryptedCinderVolumes-1253539045 tempest-TestEncryptedCinderVolumes-1253539045-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:36:40.753722 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-ac8a3b34-39df-4edc-9389-e1fa646a905d tempest-TestEncryptedCinderVolumes-1253539045 tempest-TestEncryptedCinderVolumes-1253539045-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:36:40.754125 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-ac8a3b34-39df-4edc-9389-e1fa646a905d tempest-TestEncryptedCinderVolumes-1253539045 tempest-TestEncryptedCinderVolumes-1253539045-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:36:40.754853 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-ac8a3b34-39df-4edc-9389-e1fa646a905d tempest-TestEncryptedCinderVolumes-1253539045 tempest-TestEncryptedCinderVolumes-1253539045-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:36:40.755248 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-ac8a3b34-39df-4edc-9389-e1fa646a905d tempest-TestEncryptedCinderVolumes-1253539045 tempest-TestEncryptedCinderVolumes-1253539045-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:36:40.770991 n-d-811414-3 nova-conductor[94357]: DEBUG nova.quota [None req-ac8a3b34-39df-4edc-9389-e1fa646a905d tempest-TestEncryptedCinderVolumes-1253539045 tempest-TestEncryptedCinderVolumes-1253539045-project] Getting quotas for project 3dc8c28379b34a6aa042a975027a9dac. Resources: {'instances', 'cores', 'ram'} {{(pid=94357) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 21 11:36:40.775527 n-d-811414-3 nova-conductor[94357]: DEBUG nova.quota [None req-ac8a3b34-39df-4edc-9389-e1fa646a905d tempest-TestEncryptedCinderVolumes-1253539045 tempest-TestEncryptedCinderVolumes-1253539045-project] Getting quotas for user 90c4bb2d63c54e0aa0405267f3e91205 and project 3dc8c28379b34a6aa042a975027a9dac. Resources: {'instances', 'cores', 'ram'} {{(pid=94357) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 21 11:36:40.786950 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-ac8a3b34-39df-4edc-9389-e1fa646a905d tempest-TestEncryptedCinderVolumes-1253539045 tempest-TestEncryptedCinderVolumes-1253539045-project] [instance: 3deb34ff-b28b-4206-acb2-31cf53db97fe] Selected host: n-h1-811414-3; Selected node: n-h1-811414-3; Alternates: [('n-h2-811414-3', 'n-h2-811414-3')] {{(pid=94357) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 21 11:36:40.787890 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-ac8a3b34-39df-4edc-9389-e1fa646a905d tempest-TestEncryptedCinderVolumes-1253539045 tempest-TestEncryptedCinderVolumes-1253539045-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:36:40.788286 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-ac8a3b34-39df-4edc-9389-e1fa646a905d tempest-TestEncryptedCinderVolumes-1253539045 tempest-TestEncryptedCinderVolumes-1253539045-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:36:40.794585 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-ac8a3b34-39df-4edc-9389-e1fa646a905d tempest-TestEncryptedCinderVolumes-1253539045 tempest-TestEncryptedCinderVolumes-1253539045-project] [instance: 3deb34ff-b28b-4206-acb2-31cf53db97fe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f5cdc3d5-9524-4220-a7fc-ab5606975fdb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94357) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 21 11:36:40.795948 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-ac8a3b34-39df-4edc-9389-e1fa646a905d tempest-TestEncryptedCinderVolumes-1253539045 tempest-TestEncryptedCinderVolumes-1253539045-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:36:40.796450 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-ac8a3b34-39df-4edc-9389-e1fa646a905d tempest-TestEncryptedCinderVolumes-1253539045 tempest-TestEncryptedCinderVolumes-1253539045-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:36:40.823833 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-ac8a3b34-39df-4edc-9389-e1fa646a905d tempest-TestEncryptedCinderVolumes-1253539045 tempest-TestEncryptedCinderVolumes-1253539045-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:36:40.824370 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-ac8a3b34-39df-4edc-9389-e1fa646a905d tempest-TestEncryptedCinderVolumes-1253539045 tempest-TestEncryptedCinderVolumes-1253539045-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:37:11.524981 n-d-811414-3 nova-conductor[94357]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 21 11:37:46.397501 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-25365f3e-47c0-408d-ab55-d04aea7275ee tempest-TestMinimumBasicScenario-525363234 tempest-TestMinimumBasicScenario-525363234-project] Took 0.21 seconds to select destinations for 1 instance(s). {{(pid=94358) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 21 11:37:46.419623 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-25365f3e-47c0-408d-ab55-d04aea7275ee tempest-TestMinimumBasicScenario-525363234 tempest-TestMinimumBasicScenario-525363234-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:37:46.420029 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-25365f3e-47c0-408d-ab55-d04aea7275ee tempest-TestMinimumBasicScenario-525363234 tempest-TestMinimumBasicScenario-525363234-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:37:46.472937 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-25365f3e-47c0-408d-ab55-d04aea7275ee tempest-TestMinimumBasicScenario-525363234 tempest-TestMinimumBasicScenario-525363234-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:37:46.473313 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-25365f3e-47c0-408d-ab55-d04aea7275ee tempest-TestMinimumBasicScenario-525363234 tempest-TestMinimumBasicScenario-525363234-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:37:46.474083 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-25365f3e-47c0-408d-ab55-d04aea7275ee tempest-TestMinimumBasicScenario-525363234 tempest-TestMinimumBasicScenario-525363234-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:37:46.474484 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-25365f3e-47c0-408d-ab55-d04aea7275ee tempest-TestMinimumBasicScenario-525363234 tempest-TestMinimumBasicScenario-525363234-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:37:46.489742 n-d-811414-3 nova-conductor[94358]: DEBUG nova.quota [None req-25365f3e-47c0-408d-ab55-d04aea7275ee tempest-TestMinimumBasicScenario-525363234 tempest-TestMinimumBasicScenario-525363234-project] Getting quotas for project 1e8fb18676ad46fea6a822ed7777daf2. Resources: {'instances', 'cores', 'ram'} {{(pid=94358) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 21 11:37:46.494253 n-d-811414-3 nova-conductor[94358]: DEBUG nova.quota [None req-25365f3e-47c0-408d-ab55-d04aea7275ee tempest-TestMinimumBasicScenario-525363234 tempest-TestMinimumBasicScenario-525363234-project] Getting quotas for user a989b79eb34e445c96fc859aa7b54d0e and project 1e8fb18676ad46fea6a822ed7777daf2. Resources: {'instances', 'cores', 'ram'} {{(pid=94358) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 21 11:37:46.505353 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-25365f3e-47c0-408d-ab55-d04aea7275ee tempest-TestMinimumBasicScenario-525363234 tempest-TestMinimumBasicScenario-525363234-project] [instance: b0b9fb0b-9e40-419e-aa26-98e4e447610a] Selected host: n-h1-811414-3; Selected node: n-h1-811414-3; Alternates: [('n-h2-811414-3', 'n-h2-811414-3')] {{(pid=94358) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 21 11:37:46.506245 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-25365f3e-47c0-408d-ab55-d04aea7275ee tempest-TestMinimumBasicScenario-525363234 tempest-TestMinimumBasicScenario-525363234-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:37:46.506640 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-25365f3e-47c0-408d-ab55-d04aea7275ee tempest-TestMinimumBasicScenario-525363234 tempest-TestMinimumBasicScenario-525363234-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:37:46.512548 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-25365f3e-47c0-408d-ab55-d04aea7275ee tempest-TestMinimumBasicScenario-525363234 tempest-TestMinimumBasicScenario-525363234-project] [instance: b0b9fb0b-9e40-419e-aa26-98e4e447610a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9f729fa5-6345-4502-b2a6-53589bd715cc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94358) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 21 11:37:46.513696 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-25365f3e-47c0-408d-ab55-d04aea7275ee tempest-TestMinimumBasicScenario-525363234 tempest-TestMinimumBasicScenario-525363234-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:37:46.514092 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-25365f3e-47c0-408d-ab55-d04aea7275ee tempest-TestMinimumBasicScenario-525363234 tempest-TestMinimumBasicScenario-525363234-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:37:46.538735 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-25365f3e-47c0-408d-ab55-d04aea7275ee tempest-TestMinimumBasicScenario-525363234 tempest-TestMinimumBasicScenario-525363234-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:37:46.539145 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-25365f3e-47c0-408d-ab55-d04aea7275ee tempest-TestMinimumBasicScenario-525363234 tempest-TestMinimumBasicScenario-525363234-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:37:58.457188 n-d-811414-3 nova-conductor[94358]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 21 11:38:44.378153 n-d-811414-3 nova-conductor[94357]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6404cb3a-bdc9-481c-93a6-d63501b53d9b] AMQP server on 10.222.0.13:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Apr 21 11:38:45.385825 n-d-811414-3 nova-conductor[94357]: INFO oslo.messaging._drivers.impl_rabbit [-] [6404cb3a-bdc9-481c-93a6-d63501b53d9b] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 46952. Apr 21 11:38:49.149338 n-d-811414-3 nova-conductor[94358]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f60095b5-b68f-459e-af9a-3776dcd48c13] AMQP server on 10.222.0.13:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Apr 21 11:38:50.157095 n-d-811414-3 nova-conductor[94358]: INFO oslo.messaging._drivers.impl_rabbit [-] [f60095b5-b68f-459e-af9a-3776dcd48c13] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 46964. Apr 21 11:39:21.979443 n-d-811414-3 nova-conductor[94357]: ERROR oslo.messaging._drivers.impl_rabbit [-] [511a12d4-04a9-4f3f-bc69-0b6739fdbf60] AMQP server on 10.222.0.13:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 21 11:39:22.987738 n-d-811414-3 nova-conductor[94357]: INFO oslo.messaging._drivers.impl_rabbit [-] [511a12d4-04a9-4f3f-bc69-0b6739fdbf60] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 46976. Apr 21 11:39:30.335556 n-d-811414-3 nova-conductor[94357]: ERROR oslo.messaging._drivers.impl_rabbit [-] [694bc511-65ea-420f-8d85-4aed262a2a29] AMQP server on 10.222.0.13:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 21 11:39:31.347753 n-d-811414-3 nova-conductor[94357]: INFO oslo.messaging._drivers.impl_rabbit [-] [694bc511-65ea-420f-8d85-4aed262a2a29] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 47028. Apr 21 11:39:57.689430 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-72de9135-95c4-46b4-bfd1-254fb761f039 tempest-TestNetworkAdvancedServerOps-2008571774 tempest-TestNetworkAdvancedServerOps-2008571774-project] Took 0.57 seconds to select destinations for 1 instance(s). {{(pid=94358) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 21 11:39:57.716745 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-72de9135-95c4-46b4-bfd1-254fb761f039 tempest-TestNetworkAdvancedServerOps-2008571774 tempest-TestNetworkAdvancedServerOps-2008571774-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:39:57.717156 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-72de9135-95c4-46b4-bfd1-254fb761f039 tempest-TestNetworkAdvancedServerOps-2008571774 tempest-TestNetworkAdvancedServerOps-2008571774-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:39:57.779746 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-72de9135-95c4-46b4-bfd1-254fb761f039 tempest-TestNetworkAdvancedServerOps-2008571774 tempest-TestNetworkAdvancedServerOps-2008571774-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:39:57.780177 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-72de9135-95c4-46b4-bfd1-254fb761f039 tempest-TestNetworkAdvancedServerOps-2008571774 tempest-TestNetworkAdvancedServerOps-2008571774-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:39:57.780932 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-72de9135-95c4-46b4-bfd1-254fb761f039 tempest-TestNetworkAdvancedServerOps-2008571774 tempest-TestNetworkAdvancedServerOps-2008571774-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:39:57.781317 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-72de9135-95c4-46b4-bfd1-254fb761f039 tempest-TestNetworkAdvancedServerOps-2008571774 tempest-TestNetworkAdvancedServerOps-2008571774-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:39:57.800315 n-d-811414-3 nova-conductor[94358]: DEBUG nova.quota [None req-72de9135-95c4-46b4-bfd1-254fb761f039 tempest-TestNetworkAdvancedServerOps-2008571774 tempest-TestNetworkAdvancedServerOps-2008571774-project] Getting quotas for project d79a993c49984379b56fd257bb2bbf0f. Resources: {'instances', 'cores', 'ram'} {{(pid=94358) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 21 11:39:57.806617 n-d-811414-3 nova-conductor[94358]: DEBUG nova.quota [None req-72de9135-95c4-46b4-bfd1-254fb761f039 tempest-TestNetworkAdvancedServerOps-2008571774 tempest-TestNetworkAdvancedServerOps-2008571774-project] Getting quotas for user 794c5a55ded844a888fd1e2e183cf830 and project d79a993c49984379b56fd257bb2bbf0f. Resources: {'instances', 'cores', 'ram'} {{(pid=94358) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 21 11:39:57.818429 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-72de9135-95c4-46b4-bfd1-254fb761f039 tempest-TestNetworkAdvancedServerOps-2008571774 tempest-TestNetworkAdvancedServerOps-2008571774-project] [instance: a27e2dea-6075-412c-8569-b3ee7cc98bb0] Selected host: n-h1-811414-3; Selected node: n-h1-811414-3; Alternates: [('n-h2-811414-3', 'n-h2-811414-3')] {{(pid=94358) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 21 11:39:57.819634 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-72de9135-95c4-46b4-bfd1-254fb761f039 tempest-TestNetworkAdvancedServerOps-2008571774 tempest-TestNetworkAdvancedServerOps-2008571774-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:39:57.820033 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-72de9135-95c4-46b4-bfd1-254fb761f039 tempest-TestNetworkAdvancedServerOps-2008571774 tempest-TestNetworkAdvancedServerOps-2008571774-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:39:57.827411 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-72de9135-95c4-46b4-bfd1-254fb761f039 tempest-TestNetworkAdvancedServerOps-2008571774 tempest-TestNetworkAdvancedServerOps-2008571774-project] [instance: a27e2dea-6075-412c-8569-b3ee7cc98bb0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f5cdc3d5-9524-4220-a7fc-ab5606975fdb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94358) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 21 11:39:57.828666 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-72de9135-95c4-46b4-bfd1-254fb761f039 tempest-TestNetworkAdvancedServerOps-2008571774 tempest-TestNetworkAdvancedServerOps-2008571774-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:39:57.829065 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-72de9135-95c4-46b4-bfd1-254fb761f039 tempest-TestNetworkAdvancedServerOps-2008571774 tempest-TestNetworkAdvancedServerOps-2008571774-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:39:57.858960 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-72de9135-95c4-46b4-bfd1-254fb761f039 tempest-TestNetworkAdvancedServerOps-2008571774 tempest-TestNetworkAdvancedServerOps-2008571774-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:39:57.859358 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-72de9135-95c4-46b4-bfd1-254fb761f039 tempest-TestNetworkAdvancedServerOps-2008571774 tempest-TestNetworkAdvancedServerOps-2008571774-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:40:31.533280 n-d-811414-3 nova-conductor[94357]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 21 11:41:07.063401 n-d-811414-3 nova-conductor[94357]: ERROR oslo.messaging._drivers.impl_rabbit [None req-cfd4da72-b397-4973-9b7d-97d858dfda4c tempest-TestNetworkAdvancedServerOps-2008571774 tempest-TestNetworkAdvancedServerOps-2008571774-project] [1912518d-befd-43bc-900a-8c5779444b78] AMQP server on 10.222.0.13:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Apr 21 11:41:08.072644 n-d-811414-3 nova-conductor[94357]: INFO oslo.messaging._drivers.impl_rabbit [None req-cfd4da72-b397-4973-9b7d-97d858dfda4c tempest-TestNetworkAdvancedServerOps-2008571774 tempest-TestNetworkAdvancedServerOps-2008571774-project] [1912518d-befd-43bc-900a-8c5779444b78] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 47488. Apr 21 11:41:08.383140 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-cfd4da72-b397-4973-9b7d-97d858dfda4c tempest-TestNetworkAdvancedServerOps-2008571774 tempest-TestNetworkAdvancedServerOps-2008571774-project] Took 1.33 seconds to select destinations for 1 instance(s). {{(pid=94357) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 21 11:41:08.407163 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-cfd4da72-b397-4973-9b7d-97d858dfda4c tempest-TestNetworkAdvancedServerOps-2008571774 tempest-TestNetworkAdvancedServerOps-2008571774-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:41:08.407521 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-cfd4da72-b397-4973-9b7d-97d858dfda4c tempest-TestNetworkAdvancedServerOps-2008571774 tempest-TestNetworkAdvancedServerOps-2008571774-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:41:08.457124 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-cfd4da72-b397-4973-9b7d-97d858dfda4c tempest-TestNetworkAdvancedServerOps-2008571774 tempest-TestNetworkAdvancedServerOps-2008571774-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:41:08.457521 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-cfd4da72-b397-4973-9b7d-97d858dfda4c tempest-TestNetworkAdvancedServerOps-2008571774 tempest-TestNetworkAdvancedServerOps-2008571774-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:41:08.459046 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-cfd4da72-b397-4973-9b7d-97d858dfda4c tempest-TestNetworkAdvancedServerOps-2008571774 tempest-TestNetworkAdvancedServerOps-2008571774-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:41:08.459836 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-cfd4da72-b397-4973-9b7d-97d858dfda4c tempest-TestNetworkAdvancedServerOps-2008571774 tempest-TestNetworkAdvancedServerOps-2008571774-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:41:08.479052 n-d-811414-3 nova-conductor[94357]: DEBUG nova.quota [None req-cfd4da72-b397-4973-9b7d-97d858dfda4c tempest-TestNetworkAdvancedServerOps-2008571774 tempest-TestNetworkAdvancedServerOps-2008571774-project] Getting quotas for project d79a993c49984379b56fd257bb2bbf0f. Resources: {'instances', 'cores', 'ram'} {{(pid=94357) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 21 11:41:08.483879 n-d-811414-3 nova-conductor[94357]: DEBUG nova.quota [None req-cfd4da72-b397-4973-9b7d-97d858dfda4c tempest-TestNetworkAdvancedServerOps-2008571774 tempest-TestNetworkAdvancedServerOps-2008571774-project] Getting quotas for user 794c5a55ded844a888fd1e2e183cf830 and project d79a993c49984379b56fd257bb2bbf0f. Resources: {'instances', 'cores', 'ram'} {{(pid=94357) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 21 11:41:08.511705 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-cfd4da72-b397-4973-9b7d-97d858dfda4c tempest-TestNetworkAdvancedServerOps-2008571774 tempest-TestNetworkAdvancedServerOps-2008571774-project] [instance: cc52d8d2-25d1-49af-934c-8345b0702d3b] Selected host: n-h1-811414-3; Selected node: n-h1-811414-3; Alternates: [('n-h2-811414-3', 'n-h2-811414-3')] {{(pid=94357) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 21 11:41:08.512983 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-cfd4da72-b397-4973-9b7d-97d858dfda4c tempest-TestNetworkAdvancedServerOps-2008571774 tempest-TestNetworkAdvancedServerOps-2008571774-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:41:08.513441 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-cfd4da72-b397-4973-9b7d-97d858dfda4c tempest-TestNetworkAdvancedServerOps-2008571774 tempest-TestNetworkAdvancedServerOps-2008571774-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:41:08.524191 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-cfd4da72-b397-4973-9b7d-97d858dfda4c tempest-TestNetworkAdvancedServerOps-2008571774 tempest-TestNetworkAdvancedServerOps-2008571774-project] [instance: cc52d8d2-25d1-49af-934c-8345b0702d3b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f5cdc3d5-9524-4220-a7fc-ab5606975fdb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94357) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 21 11:41:08.525565 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-cfd4da72-b397-4973-9b7d-97d858dfda4c tempest-TestNetworkAdvancedServerOps-2008571774 tempest-TestNetworkAdvancedServerOps-2008571774-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:41:08.526035 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-cfd4da72-b397-4973-9b7d-97d858dfda4c tempest-TestNetworkAdvancedServerOps-2008571774 tempest-TestNetworkAdvancedServerOps-2008571774-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:41:08.557822 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-cfd4da72-b397-4973-9b7d-97d858dfda4c tempest-TestNetworkAdvancedServerOps-2008571774 tempest-TestNetworkAdvancedServerOps-2008571774-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:41:08.558220 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-cfd4da72-b397-4973-9b7d-97d858dfda4c tempest-TestNetworkAdvancedServerOps-2008571774 tempest-TestNetworkAdvancedServerOps-2008571774-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:41:08.568273 n-d-811414-3 nova-conductor[94357]: ERROR oslo.messaging._drivers.impl_rabbit [None req-cfd4da72-b397-4973-9b7d-97d858dfda4c tempest-TestNetworkAdvancedServerOps-2008571774 tempest-TestNetworkAdvancedServerOps-2008571774-project] [03daea1f-d18b-4535-9b44-e39098845aec] AMQP server on 10.222.0.13:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Apr 21 11:41:09.575198 n-d-811414-3 nova-conductor[94357]: INFO oslo.messaging._drivers.impl_rabbit [None req-cfd4da72-b397-4973-9b7d-97d858dfda4c tempest-TestNetworkAdvancedServerOps-2008571774 tempest-TestNetworkAdvancedServerOps-2008571774-project] [03daea1f-d18b-4535-9b44-e39098845aec] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 47512. Apr 21 11:41:18.466205 n-d-811414-3 nova-conductor[94358]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 21 11:41:45.387310 n-d-811414-3 nova-conductor[94357]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6404cb3a-bdc9-481c-93a6-d63501b53d9b] AMQP server on 10.222.0.13:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Apr 21 11:41:46.394827 n-d-811414-3 nova-conductor[94357]: INFO oslo.messaging._drivers.impl_rabbit [-] [6404cb3a-bdc9-481c-93a6-d63501b53d9b] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 47574. Apr 21 11:41:50.158098 n-d-811414-3 nova-conductor[94358]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f60095b5-b68f-459e-af9a-3776dcd48c13] AMQP server on 10.222.0.13:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Apr 21 11:41:51.165337 n-d-811414-3 nova-conductor[94358]: INFO oslo.messaging._drivers.impl_rabbit [-] [f60095b5-b68f-459e-af9a-3776dcd48c13] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 47580. Apr 21 11:42:20.501429 n-d-811414-3 nova-conductor[94358]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f74a9f7c-07ff-404c-aef6-df527a438fd3] AMQP server on 10.222.0.13:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 21 11:42:21.509488 n-d-811414-3 nova-conductor[94358]: INFO oslo.messaging._drivers.impl_rabbit [-] [f74a9f7c-07ff-404c-aef6-df527a438fd3] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 47624. Apr 21 11:42:31.342296 n-d-811414-3 nova-conductor[94358]: ERROR oslo.messaging._drivers.impl_rabbit [-] [764b4c1f-4a95-4767-989c-d3f562ce3759] AMQP server on 10.222.0.13:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 21 11:42:32.355181 n-d-811414-3 nova-conductor[94358]: INFO oslo.messaging._drivers.impl_rabbit [-] [764b4c1f-4a95-4767-989c-d3f562ce3759] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 47630. Apr 21 11:43:04.577975 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-9872cbf9-f5a9-4f33-9a3b-9fae65c50451 tempest-TestNetworkAdvancedServerOps-2008571774 tempest-TestNetworkAdvancedServerOps-2008571774-project] Took 0.22 seconds to select destinations for 1 instance(s). {{(pid=94357) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 21 11:43:04.601585 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-9872cbf9-f5a9-4f33-9a3b-9fae65c50451 tempest-TestNetworkAdvancedServerOps-2008571774 tempest-TestNetworkAdvancedServerOps-2008571774-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:43:04.601989 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-9872cbf9-f5a9-4f33-9a3b-9fae65c50451 tempest-TestNetworkAdvancedServerOps-2008571774 tempest-TestNetworkAdvancedServerOps-2008571774-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:43:04.648889 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-9872cbf9-f5a9-4f33-9a3b-9fae65c50451 tempest-TestNetworkAdvancedServerOps-2008571774 tempest-TestNetworkAdvancedServerOps-2008571774-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:43:04.649294 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-9872cbf9-f5a9-4f33-9a3b-9fae65c50451 tempest-TestNetworkAdvancedServerOps-2008571774 tempest-TestNetworkAdvancedServerOps-2008571774-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:43:04.650018 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-9872cbf9-f5a9-4f33-9a3b-9fae65c50451 tempest-TestNetworkAdvancedServerOps-2008571774 tempest-TestNetworkAdvancedServerOps-2008571774-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:43:04.650406 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-9872cbf9-f5a9-4f33-9a3b-9fae65c50451 tempest-TestNetworkAdvancedServerOps-2008571774 tempest-TestNetworkAdvancedServerOps-2008571774-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:43:04.665788 n-d-811414-3 nova-conductor[94357]: DEBUG nova.quota [None req-9872cbf9-f5a9-4f33-9a3b-9fae65c50451 tempest-TestNetworkAdvancedServerOps-2008571774 tempest-TestNetworkAdvancedServerOps-2008571774-project] Getting quotas for project d79a993c49984379b56fd257bb2bbf0f. Resources: {'instances', 'cores', 'ram'} {{(pid=94357) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 21 11:43:04.670328 n-d-811414-3 nova-conductor[94357]: DEBUG nova.quota [None req-9872cbf9-f5a9-4f33-9a3b-9fae65c50451 tempest-TestNetworkAdvancedServerOps-2008571774 tempest-TestNetworkAdvancedServerOps-2008571774-project] Getting quotas for user 794c5a55ded844a888fd1e2e183cf830 and project d79a993c49984379b56fd257bb2bbf0f. Resources: {'instances', 'cores', 'ram'} {{(pid=94357) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 21 11:43:04.681802 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-9872cbf9-f5a9-4f33-9a3b-9fae65c50451 tempest-TestNetworkAdvancedServerOps-2008571774 tempest-TestNetworkAdvancedServerOps-2008571774-project] [instance: 4112c4d0-871a-48bc-9e93-3629293925ad] Selected host: n-h1-811414-3; Selected node: n-h1-811414-3; Alternates: [('n-h2-811414-3', 'n-h2-811414-3')] {{(pid=94357) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 21 11:43:04.682762 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-9872cbf9-f5a9-4f33-9a3b-9fae65c50451 tempest-TestNetworkAdvancedServerOps-2008571774 tempest-TestNetworkAdvancedServerOps-2008571774-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:43:04.683165 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-9872cbf9-f5a9-4f33-9a3b-9fae65c50451 tempest-TestNetworkAdvancedServerOps-2008571774 tempest-TestNetworkAdvancedServerOps-2008571774-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:43:04.690822 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-9872cbf9-f5a9-4f33-9a3b-9fae65c50451 tempest-TestNetworkAdvancedServerOps-2008571774 tempest-TestNetworkAdvancedServerOps-2008571774-project] [instance: 4112c4d0-871a-48bc-9e93-3629293925ad] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f5cdc3d5-9524-4220-a7fc-ab5606975fdb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94357) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 21 11:43:04.692794 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-9872cbf9-f5a9-4f33-9a3b-9fae65c50451 tempest-TestNetworkAdvancedServerOps-2008571774 tempest-TestNetworkAdvancedServerOps-2008571774-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:43:04.693237 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-9872cbf9-f5a9-4f33-9a3b-9fae65c50451 tempest-TestNetworkAdvancedServerOps-2008571774 tempest-TestNetworkAdvancedServerOps-2008571774-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:43:04.729984 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-9872cbf9-f5a9-4f33-9a3b-9fae65c50451 tempest-TestNetworkAdvancedServerOps-2008571774 tempest-TestNetworkAdvancedServerOps-2008571774-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:43:04.730469 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-9872cbf9-f5a9-4f33-9a3b-9fae65c50451 tempest-TestNetworkAdvancedServerOps-2008571774 tempest-TestNetworkAdvancedServerOps-2008571774-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:43:46.585585 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-b1ac290c-b83b-446d-8c33-7da6e6a4b71e tempest-TestNetworkAdvancedServerOps-2008571774 tempest-TestNetworkAdvancedServerOps-2008571774-project] Targeting cell 6c99d8ec-fb48-48af-b02b-a629a7c2cb6b(cell1) for conductor method migrate_server {{(pid=94358) wrapper /opt/stack/nova/nova/conductor/manager.py:91}} Apr 21 11:43:46.586085 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-b1ac290c-b83b-446d-8c33-7da6e6a4b71e tempest-TestNetworkAdvancedServerOps-2008571774 tempest-TestNetworkAdvancedServerOps-2008571774-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:43:46.586483 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-b1ac290c-b83b-446d-8c33-7da6e6a4b71e tempest-TestNetworkAdvancedServerOps-2008571774 tempest-TestNetworkAdvancedServerOps-2008571774-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:43:46.776664 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.tasks.migrate [None req-b1ac290c-b83b-446d-8c33-7da6e6a4b71e tempest-TestNetworkAdvancedServerOps-2008571774 tempest-TestNetworkAdvancedServerOps-2008571774-project] [instance: 4112c4d0-871a-48bc-9e93-3629293925ad] Restricting to cell 6c99d8ec-fb48-48af-b02b-a629a7c2cb6b(cell1) while migrating {{(pid=94358) _set_requested_destination_cell /opt/stack/nova/nova/conductor/tasks/migrate.py:208}} Apr 21 11:43:47.032058 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.tasks.migrate [None req-b1ac290c-b83b-446d-8c33-7da6e6a4b71e tempest-TestNetworkAdvancedServerOps-2008571774 tempest-TestNetworkAdvancedServerOps-2008571774-project] Created allocations for migration 83cb2ac4-bd2f-4322-bc5b-699342ef9cf7 on 43480f3a-fb09-463e-8326-6927c98a38b4 {{(pid=94358) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} Apr 21 11:43:48.245104 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.tasks.migrate [None req-b1ac290c-b83b-446d-8c33-7da6e6a4b71e tempest-TestNetworkAdvancedServerOps-2008571774 tempest-TestNetworkAdvancedServerOps-2008571774-project] [instance: 4112c4d0-871a-48bc-9e93-3629293925ad] Calling prep_resize with selected host: n-h2-811414-3; Selected node: n-h2-811414-3; Alternates: [Selection(allocation_request='{"allocations": {"43480f3a-fb09-463e-8326-6927c98a38b4": {"resources": {"DISK_GB": 1, "MEMORY_MB": 512, "VCPU": 1}}}, "mappings": {"": ["43480f3a-fb09-463e-8326-6927c98a38b4"]}}',allocation_request_version='1.35',availability_zone='nova',cell_uuid=6c99d8ec-fb48-48af-b02b-a629a7c2cb6b,compute_node_uuid=43480f3a-fb09-463e-8326-6927c98a38b4,limits=SchedulerLimits,nodename='n-h1-811414-3',service_host='n-h1-811414-3')] {{(pid=94358) _execute /opt/stack/nova/nova/conductor/tasks/migrate.py:315}} Apr 21 11:43:51.541184 n-d-811414-3 nova-conductor[94357]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 21 11:44:38.474820 n-d-811414-3 nova-conductor[94358]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 21 11:44:46.396492 n-d-811414-3 nova-conductor[94357]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6404cb3a-bdc9-481c-93a6-d63501b53d9b] AMQP server on 10.222.0.13:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 21 11:44:47.404626 n-d-811414-3 nova-conductor[94357]: INFO oslo.messaging._drivers.impl_rabbit [-] [6404cb3a-bdc9-481c-93a6-d63501b53d9b] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 48006. Apr 21 11:44:51.166524 n-d-811414-3 nova-conductor[94358]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f60095b5-b68f-459e-af9a-3776dcd48c13] AMQP server on 10.222.0.13:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Apr 21 11:44:52.176059 n-d-811414-3 nova-conductor[94358]: INFO oslo.messaging._drivers.impl_rabbit [-] [f60095b5-b68f-459e-af9a-3776dcd48c13] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 48032. Apr 21 11:44:54.918933 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-a22c5746-4ebd-4c66-858f-fce7aa2fa3ef tempest-TestNetworkAdvancedServerOps-2008571774 tempest-TestNetworkAdvancedServerOps-2008571774-project] Took 0.23 seconds to select destinations for 1 instance(s). {{(pid=94357) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 21 11:44:54.941959 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-a22c5746-4ebd-4c66-858f-fce7aa2fa3ef tempest-TestNetworkAdvancedServerOps-2008571774 tempest-TestNetworkAdvancedServerOps-2008571774-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:44:54.942512 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-a22c5746-4ebd-4c66-858f-fce7aa2fa3ef tempest-TestNetworkAdvancedServerOps-2008571774 tempest-TestNetworkAdvancedServerOps-2008571774-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:44:54.986654 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-a22c5746-4ebd-4c66-858f-fce7aa2fa3ef tempest-TestNetworkAdvancedServerOps-2008571774 tempest-TestNetworkAdvancedServerOps-2008571774-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:44:54.987010 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-a22c5746-4ebd-4c66-858f-fce7aa2fa3ef tempest-TestNetworkAdvancedServerOps-2008571774 tempest-TestNetworkAdvancedServerOps-2008571774-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:44:54.987684 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-a22c5746-4ebd-4c66-858f-fce7aa2fa3ef tempest-TestNetworkAdvancedServerOps-2008571774 tempest-TestNetworkAdvancedServerOps-2008571774-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:44:54.988072 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-a22c5746-4ebd-4c66-858f-fce7aa2fa3ef tempest-TestNetworkAdvancedServerOps-2008571774 tempest-TestNetworkAdvancedServerOps-2008571774-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:44:55.006928 n-d-811414-3 nova-conductor[94357]: DEBUG nova.quota [None req-a22c5746-4ebd-4c66-858f-fce7aa2fa3ef tempest-TestNetworkAdvancedServerOps-2008571774 tempest-TestNetworkAdvancedServerOps-2008571774-project] Getting quotas for project d79a993c49984379b56fd257bb2bbf0f. Resources: {'instances', 'cores', 'ram'} {{(pid=94357) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 21 11:44:55.011743 n-d-811414-3 nova-conductor[94357]: DEBUG nova.quota [None req-a22c5746-4ebd-4c66-858f-fce7aa2fa3ef tempest-TestNetworkAdvancedServerOps-2008571774 tempest-TestNetworkAdvancedServerOps-2008571774-project] Getting quotas for user 794c5a55ded844a888fd1e2e183cf830 and project d79a993c49984379b56fd257bb2bbf0f. Resources: {'instances', 'cores', 'ram'} {{(pid=94357) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 21 11:44:55.024156 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-a22c5746-4ebd-4c66-858f-fce7aa2fa3ef tempest-TestNetworkAdvancedServerOps-2008571774 tempest-TestNetworkAdvancedServerOps-2008571774-project] [instance: 5e59e2d8-5d4d-4204-b828-d0a28cdd5328] Selected host: n-h1-811414-3; Selected node: n-h1-811414-3; Alternates: [('n-h2-811414-3', 'n-h2-811414-3')] {{(pid=94357) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 21 11:44:55.025132 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-a22c5746-4ebd-4c66-858f-fce7aa2fa3ef tempest-TestNetworkAdvancedServerOps-2008571774 tempest-TestNetworkAdvancedServerOps-2008571774-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:44:55.025553 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-a22c5746-4ebd-4c66-858f-fce7aa2fa3ef tempest-TestNetworkAdvancedServerOps-2008571774 tempest-TestNetworkAdvancedServerOps-2008571774-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:44:55.032188 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-a22c5746-4ebd-4c66-858f-fce7aa2fa3ef tempest-TestNetworkAdvancedServerOps-2008571774 tempest-TestNetworkAdvancedServerOps-2008571774-project] [instance: 5e59e2d8-5d4d-4204-b828-d0a28cdd5328] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f5cdc3d5-9524-4220-a7fc-ab5606975fdb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94357) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 21 11:44:55.033484 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-a22c5746-4ebd-4c66-858f-fce7aa2fa3ef tempest-TestNetworkAdvancedServerOps-2008571774 tempest-TestNetworkAdvancedServerOps-2008571774-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:44:55.033871 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-a22c5746-4ebd-4c66-858f-fce7aa2fa3ef tempest-TestNetworkAdvancedServerOps-2008571774 tempest-TestNetworkAdvancedServerOps-2008571774-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:44:55.066115 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-a22c5746-4ebd-4c66-858f-fce7aa2fa3ef tempest-TestNetworkAdvancedServerOps-2008571774 tempest-TestNetworkAdvancedServerOps-2008571774-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:44:55.066519 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-a22c5746-4ebd-4c66-858f-fce7aa2fa3ef tempest-TestNetworkAdvancedServerOps-2008571774 tempest-TestNetworkAdvancedServerOps-2008571774-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:46:21.511392 n-d-811414-3 nova-conductor[94358]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f74a9f7c-07ff-404c-aef6-df527a438fd3] AMQP server on 10.222.0.13:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 21 11:46:22.519902 n-d-811414-3 nova-conductor[94358]: INFO oslo.messaging._drivers.impl_rabbit [-] [f74a9f7c-07ff-404c-aef6-df527a438fd3] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 48168. Apr 21 11:46:32.352397 n-d-811414-3 nova-conductor[94358]: ERROR oslo.messaging._drivers.impl_rabbit [-] [764b4c1f-4a95-4767-989c-d3f562ce3759] AMQP server on 10.222.0.13:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 21 11:46:33.367261 n-d-811414-3 nova-conductor[94358]: INFO oslo.messaging._drivers.impl_rabbit [-] [764b4c1f-4a95-4767-989c-d3f562ce3759] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 48248. Apr 21 11:46:38.557553 n-d-811414-3 nova-conductor[94358]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 21 11:46:40.974838 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-bd489ce4-7a45-4c12-9175-8c8ae120b5aa tempest-TestNetworkAdvancedServerOps-2008571774 tempest-TestNetworkAdvancedServerOps-2008571774-project] Took 0.33 seconds to select destinations for 1 instance(s). {{(pid=94357) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 21 11:46:41.012089 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-bd489ce4-7a45-4c12-9175-8c8ae120b5aa tempest-TestNetworkAdvancedServerOps-2008571774 tempest-TestNetworkAdvancedServerOps-2008571774-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:46:41.012568 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-bd489ce4-7a45-4c12-9175-8c8ae120b5aa tempest-TestNetworkAdvancedServerOps-2008571774 tempest-TestNetworkAdvancedServerOps-2008571774-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:46:41.058769 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-bd489ce4-7a45-4c12-9175-8c8ae120b5aa tempest-TestNetworkAdvancedServerOps-2008571774 tempest-TestNetworkAdvancedServerOps-2008571774-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:46:41.059069 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-bd489ce4-7a45-4c12-9175-8c8ae120b5aa tempest-TestNetworkAdvancedServerOps-2008571774 tempest-TestNetworkAdvancedServerOps-2008571774-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:46:41.059857 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-bd489ce4-7a45-4c12-9175-8c8ae120b5aa tempest-TestNetworkAdvancedServerOps-2008571774 tempest-TestNetworkAdvancedServerOps-2008571774-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:46:41.060305 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-bd489ce4-7a45-4c12-9175-8c8ae120b5aa tempest-TestNetworkAdvancedServerOps-2008571774 tempest-TestNetworkAdvancedServerOps-2008571774-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:46:41.081001 n-d-811414-3 nova-conductor[94357]: DEBUG nova.quota [None req-bd489ce4-7a45-4c12-9175-8c8ae120b5aa tempest-TestNetworkAdvancedServerOps-2008571774 tempest-TestNetworkAdvancedServerOps-2008571774-project] Getting quotas for project d79a993c49984379b56fd257bb2bbf0f. Resources: {'instances', 'cores', 'ram'} {{(pid=94357) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 21 11:46:41.088974 n-d-811414-3 nova-conductor[94357]: DEBUG nova.quota [None req-bd489ce4-7a45-4c12-9175-8c8ae120b5aa tempest-TestNetworkAdvancedServerOps-2008571774 tempest-TestNetworkAdvancedServerOps-2008571774-project] Getting quotas for user 794c5a55ded844a888fd1e2e183cf830 and project d79a993c49984379b56fd257bb2bbf0f. Resources: {'instances', 'cores', 'ram'} {{(pid=94357) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 21 11:46:41.102011 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-bd489ce4-7a45-4c12-9175-8c8ae120b5aa tempest-TestNetworkAdvancedServerOps-2008571774 tempest-TestNetworkAdvancedServerOps-2008571774-project] [instance: 2c75535c-69b6-43d0-95ef-60156573a39c] Selected host: n-h1-811414-3; Selected node: n-h1-811414-3; Alternates: [('n-h2-811414-3', 'n-h2-811414-3')] {{(pid=94357) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 21 11:46:41.103003 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-bd489ce4-7a45-4c12-9175-8c8ae120b5aa tempest-TestNetworkAdvancedServerOps-2008571774 tempest-TestNetworkAdvancedServerOps-2008571774-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:46:41.103620 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-bd489ce4-7a45-4c12-9175-8c8ae120b5aa tempest-TestNetworkAdvancedServerOps-2008571774 tempest-TestNetworkAdvancedServerOps-2008571774-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:46:41.111554 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-bd489ce4-7a45-4c12-9175-8c8ae120b5aa tempest-TestNetworkAdvancedServerOps-2008571774 tempest-TestNetworkAdvancedServerOps-2008571774-project] [instance: 2c75535c-69b6-43d0-95ef-60156573a39c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f5cdc3d5-9524-4220-a7fc-ab5606975fdb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94357) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 21 11:46:41.112842 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-bd489ce4-7a45-4c12-9175-8c8ae120b5aa tempest-TestNetworkAdvancedServerOps-2008571774 tempest-TestNetworkAdvancedServerOps-2008571774-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:46:41.113242 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-bd489ce4-7a45-4c12-9175-8c8ae120b5aa tempest-TestNetworkAdvancedServerOps-2008571774 tempest-TestNetworkAdvancedServerOps-2008571774-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:46:41.145736 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-bd489ce4-7a45-4c12-9175-8c8ae120b5aa tempest-TestNetworkAdvancedServerOps-2008571774 tempest-TestNetworkAdvancedServerOps-2008571774-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:46:41.145736 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-bd489ce4-7a45-4c12-9175-8c8ae120b5aa tempest-TestNetworkAdvancedServerOps-2008571774 tempest-TestNetworkAdvancedServerOps-2008571774-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:46:41.232897 n-d-811414-3 nova-conductor[94358]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 21 11:47:11.549154 n-d-811414-3 nova-conductor[94357]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 21 11:47:47.405200 n-d-811414-3 nova-conductor[94357]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6404cb3a-bdc9-481c-93a6-d63501b53d9b] AMQP server on 10.222.0.13:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Apr 21 11:47:48.418149 n-d-811414-3 nova-conductor[94357]: INFO oslo.messaging._drivers.impl_rabbit [-] [6404cb3a-bdc9-481c-93a6-d63501b53d9b] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 48492. Apr 21 11:47:52.179322 n-d-811414-3 nova-conductor[94358]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f60095b5-b68f-459e-af9a-3776dcd48c13] AMQP server on 10.222.0.13:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Apr 21 11:47:53.191523 n-d-811414-3 nova-conductor[94358]: INFO oslo.messaging._drivers.impl_rabbit [-] [f60095b5-b68f-459e-af9a-3776dcd48c13] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 48524. Apr 21 11:47:58.487032 n-d-811414-3 nova-conductor[94358]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 21 11:48:01.447999 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-3525fcb7-cb22-466b-8e5e-115437fc7f7f tempest-TestShelveInstance-1316874115 tempest-TestShelveInstance-1316874115-project] Took 0.45 seconds to select destinations for 1 instance(s). {{(pid=94358) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 21 11:48:01.471589 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-3525fcb7-cb22-466b-8e5e-115437fc7f7f tempest-TestShelveInstance-1316874115 tempest-TestShelveInstance-1316874115-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:48:01.472036 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-3525fcb7-cb22-466b-8e5e-115437fc7f7f tempest-TestShelveInstance-1316874115 tempest-TestShelveInstance-1316874115-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:48:01.525326 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-3525fcb7-cb22-466b-8e5e-115437fc7f7f tempest-TestShelveInstance-1316874115 tempest-TestShelveInstance-1316874115-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:48:01.525734 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-3525fcb7-cb22-466b-8e5e-115437fc7f7f tempest-TestShelveInstance-1316874115 tempest-TestShelveInstance-1316874115-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:48:01.526469 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-3525fcb7-cb22-466b-8e5e-115437fc7f7f tempest-TestShelveInstance-1316874115 tempest-TestShelveInstance-1316874115-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:48:01.526860 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-3525fcb7-cb22-466b-8e5e-115437fc7f7f tempest-TestShelveInstance-1316874115 tempest-TestShelveInstance-1316874115-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:48:01.542414 n-d-811414-3 nova-conductor[94358]: DEBUG nova.quota [None req-3525fcb7-cb22-466b-8e5e-115437fc7f7f tempest-TestShelveInstance-1316874115 tempest-TestShelveInstance-1316874115-project] Getting quotas for project d394d1b7cbd945da984721a578c25f79. Resources: {'instances', 'cores', 'ram'} {{(pid=94358) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 21 11:48:01.547234 n-d-811414-3 nova-conductor[94358]: DEBUG nova.quota [None req-3525fcb7-cb22-466b-8e5e-115437fc7f7f tempest-TestShelveInstance-1316874115 tempest-TestShelveInstance-1316874115-project] Getting quotas for user e0236cfd0e8c488d96973b57560f9445 and project d394d1b7cbd945da984721a578c25f79. Resources: {'instances', 'cores', 'ram'} {{(pid=94358) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 21 11:48:01.557709 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-3525fcb7-cb22-466b-8e5e-115437fc7f7f tempest-TestShelveInstance-1316874115 tempest-TestShelveInstance-1316874115-project] [instance: d0ac6c3f-95b0-4144-87af-bd4facb6632f] Selected host: n-h1-811414-3; Selected node: n-h1-811414-3; Alternates: [('n-h2-811414-3', 'n-h2-811414-3')] {{(pid=94358) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 21 11:48:01.558652 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-3525fcb7-cb22-466b-8e5e-115437fc7f7f tempest-TestShelveInstance-1316874115 tempest-TestShelveInstance-1316874115-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:48:01.559052 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-3525fcb7-cb22-466b-8e5e-115437fc7f7f tempest-TestShelveInstance-1316874115 tempest-TestShelveInstance-1316874115-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:48:01.566999 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-3525fcb7-cb22-466b-8e5e-115437fc7f7f tempest-TestShelveInstance-1316874115 tempest-TestShelveInstance-1316874115-project] [instance: d0ac6c3f-95b0-4144-87af-bd4facb6632f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f5cdc3d5-9524-4220-a7fc-ab5606975fdb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94358) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 21 11:48:01.568461 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-3525fcb7-cb22-466b-8e5e-115437fc7f7f tempest-TestShelveInstance-1316874115 tempest-TestShelveInstance-1316874115-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:48:01.568825 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-3525fcb7-cb22-466b-8e5e-115437fc7f7f tempest-TestShelveInstance-1316874115 tempest-TestShelveInstance-1316874115-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:48:01.598338 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-3525fcb7-cb22-466b-8e5e-115437fc7f7f tempest-TestShelveInstance-1316874115 tempest-TestShelveInstance-1316874115-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:48:01.598759 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-3525fcb7-cb22-466b-8e5e-115437fc7f7f tempest-TestShelveInstance-1316874115 tempest-TestShelveInstance-1316874115-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:49:22.995300 n-d-811414-3 nova-conductor[94357]: ERROR oslo.messaging._drivers.impl_rabbit [-] [511a12d4-04a9-4f3f-bc69-0b6739fdbf60] AMQP server on 10.222.0.13:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 21 11:49:24.002684 n-d-811414-3 nova-conductor[94357]: INFO oslo.messaging._drivers.impl_rabbit [-] [511a12d4-04a9-4f3f-bc69-0b6739fdbf60] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 48654. Apr 21 11:49:31.351253 n-d-811414-3 nova-conductor[94357]: ERROR oslo.messaging._drivers.impl_rabbit [-] [694bc511-65ea-420f-8d85-4aed262a2a29] AMQP server on 10.222.0.13:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 21 11:49:32.363800 n-d-811414-3 nova-conductor[94357]: INFO oslo.messaging._drivers.impl_rabbit [-] [694bc511-65ea-420f-8d85-4aed262a2a29] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 48660. Apr 21 11:50:22.522632 n-d-811414-3 nova-conductor[94358]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f74a9f7c-07ff-404c-aef6-df527a438fd3] AMQP server on 10.222.0.13:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 21 11:50:23.530639 n-d-811414-3 nova-conductor[94358]: INFO oslo.messaging._drivers.impl_rabbit [-] [f74a9f7c-07ff-404c-aef6-df527a438fd3] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 48740. Apr 21 11:50:31.556987 n-d-811414-3 nova-conductor[94357]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 21 11:50:33.363960 n-d-811414-3 nova-conductor[94358]: ERROR oslo.messaging._drivers.impl_rabbit [-] [764b4c1f-4a95-4767-989c-d3f562ce3759] AMQP server on 10.222.0.13:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 21 11:50:34.377047 n-d-811414-3 nova-conductor[94358]: INFO oslo.messaging._drivers.impl_rabbit [-] [764b4c1f-4a95-4767-989c-d3f562ce3759] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 48792. Apr 21 11:50:36.217092 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-7408ec8e-39e7-4041-8883-c7852895afae tempest-TestShelveInstance-1316874115 tempest-TestShelveInstance-1316874115-project] Targeting cell 6c99d8ec-fb48-48af-b02b-a629a7c2cb6b(cell1) for conductor method unshelve_instance {{(pid=94357) wrapper /opt/stack/nova/nova/conductor/manager.py:91}} Apr 21 11:50:36.217736 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-7408ec8e-39e7-4041-8883-c7852895afae tempest-TestShelveInstance-1316874115 tempest-TestShelveInstance-1316874115-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:50:36.219006 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-7408ec8e-39e7-4041-8883-c7852895afae tempest-TestShelveInstance-1316874115 tempest-TestShelveInstance-1316874115-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:50:36.774587 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-7408ec8e-39e7-4041-8883-c7852895afae tempest-TestShelveInstance-1316874115 tempest-TestShelveInstance-1316874115-project] [instance: d0ac6c3f-95b0-4144-87af-bd4facb6632f] Requesting cell 6c99d8ec-fb48-48af-b02b-a629a7c2cb6b(cell1) during scheduling {{(pid=94357) _restrict_request_spec_to_cell /opt/stack/nova/nova/conductor/manager.py:902}} Apr 21 11:50:36.988721 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-7408ec8e-39e7-4041-8883-c7852895afae tempest-TestShelveInstance-1316874115 tempest-TestShelveInstance-1316874115-project] Took 0.21 seconds to select destinations for 1 instance(s). {{(pid=94357) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 21 11:50:36.996332 n-d-811414-3 nova-conductor[94357]: DEBUG nova.objects.instance [None req-7408ec8e-39e7-4041-8883-c7852895afae tempest-TestShelveInstance-1316874115 tempest-TestShelveInstance-1316874115-project] Lazy-loading 'flavor' on Instance uuid d0ac6c3f-95b0-4144-87af-bd4facb6632f {{(pid=94357) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Apr 21 11:50:48.416429 n-d-811414-3 nova-conductor[94357]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6404cb3a-bdc9-481c-93a6-d63501b53d9b] AMQP server on 10.222.0.13:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Apr 21 11:50:49.424929 n-d-811414-3 nova-conductor[94357]: INFO oslo.messaging._drivers.impl_rabbit [-] [6404cb3a-bdc9-481c-93a6-d63501b53d9b] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 48876. Apr 21 11:50:53.191172 n-d-811414-3 nova-conductor[94358]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f60095b5-b68f-459e-af9a-3776dcd48c13] AMQP server on 10.222.0.13:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Apr 21 11:50:54.197652 n-d-811414-3 nova-conductor[94358]: INFO oslo.messaging._drivers.impl_rabbit [-] [f60095b5-b68f-459e-af9a-3776dcd48c13] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 48924. Apr 21 11:51:18.494900 n-d-811414-3 nova-conductor[94358]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 21 11:52:24.026183 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-03e30960-54c8-48a8-8494-8e8d49c9b35e tempest-TestShelveInstance-1316874115 tempest-TestShelveInstance-1316874115-project] Took 0.19 seconds to select destinations for 1 instance(s). {{(pid=94358) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 21 11:52:24.049326 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-03e30960-54c8-48a8-8494-8e8d49c9b35e tempest-TestShelveInstance-1316874115 tempest-TestShelveInstance-1316874115-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:52:24.049730 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-03e30960-54c8-48a8-8494-8e8d49c9b35e tempest-TestShelveInstance-1316874115 tempest-TestShelveInstance-1316874115-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:52:24.092075 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-03e30960-54c8-48a8-8494-8e8d49c9b35e tempest-TestShelveInstance-1316874115 tempest-TestShelveInstance-1316874115-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:52:24.092503 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-03e30960-54c8-48a8-8494-8e8d49c9b35e tempest-TestShelveInstance-1316874115 tempest-TestShelveInstance-1316874115-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:52:24.093216 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-03e30960-54c8-48a8-8494-8e8d49c9b35e tempest-TestShelveInstance-1316874115 tempest-TestShelveInstance-1316874115-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:52:24.093597 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-03e30960-54c8-48a8-8494-8e8d49c9b35e tempest-TestShelveInstance-1316874115 tempest-TestShelveInstance-1316874115-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:52:24.108573 n-d-811414-3 nova-conductor[94358]: DEBUG nova.quota [None req-03e30960-54c8-48a8-8494-8e8d49c9b35e tempest-TestShelveInstance-1316874115 tempest-TestShelveInstance-1316874115-project] Getting quotas for project d394d1b7cbd945da984721a578c25f79. Resources: {'instances', 'cores', 'ram'} {{(pid=94358) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 21 11:52:24.113762 n-d-811414-3 nova-conductor[94358]: DEBUG nova.quota [None req-03e30960-54c8-48a8-8494-8e8d49c9b35e tempest-TestShelveInstance-1316874115 tempest-TestShelveInstance-1316874115-project] Getting quotas for user e0236cfd0e8c488d96973b57560f9445 and project d394d1b7cbd945da984721a578c25f79. Resources: {'instances', 'cores', 'ram'} {{(pid=94358) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 21 11:52:24.123903 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-03e30960-54c8-48a8-8494-8e8d49c9b35e tempest-TestShelveInstance-1316874115 tempest-TestShelveInstance-1316874115-project] [instance: e22cb8c5-9307-4261-8f1b-f582770d589d] Selected host: n-h1-811414-3; Selected node: n-h1-811414-3; Alternates: [('n-h2-811414-3', 'n-h2-811414-3')] {{(pid=94358) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 21 11:52:24.124808 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-03e30960-54c8-48a8-8494-8e8d49c9b35e tempest-TestShelveInstance-1316874115 tempest-TestShelveInstance-1316874115-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:52:24.125223 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-03e30960-54c8-48a8-8494-8e8d49c9b35e tempest-TestShelveInstance-1316874115 tempest-TestShelveInstance-1316874115-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:52:24.131713 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-03e30960-54c8-48a8-8494-8e8d49c9b35e tempest-TestShelveInstance-1316874115 tempest-TestShelveInstance-1316874115-project] [instance: e22cb8c5-9307-4261-8f1b-f582770d589d] block_device_mapping [BlockDeviceMapping(attachment_id=806878d9-97ce-4f6f-a4c4-dc16c6a5dd8b,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='bc8cebf6-02c8-42d3-b9ab-6a46d5e6f7e1',volume_size=1,volume_type=None)] {{(pid=94358) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 21 11:52:24.133172 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-03e30960-54c8-48a8-8494-8e8d49c9b35e tempest-TestShelveInstance-1316874115 tempest-TestShelveInstance-1316874115-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:52:24.133574 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-03e30960-54c8-48a8-8494-8e8d49c9b35e tempest-TestShelveInstance-1316874115 tempest-TestShelveInstance-1316874115-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:52:24.160283 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-03e30960-54c8-48a8-8494-8e8d49c9b35e tempest-TestShelveInstance-1316874115 tempest-TestShelveInstance-1316874115-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:52:24.160657 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-03e30960-54c8-48a8-8494-8e8d49c9b35e tempest-TestShelveInstance-1316874115 tempest-TestShelveInstance-1316874115-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:53:21.058163 n-d-811414-3 nova-conductor[94357]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 21 11:53:22.305450 n-d-811414-3 nova-conductor[94357]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 21 11:53:24.004506 n-d-811414-3 nova-conductor[94357]: ERROR oslo.messaging._drivers.impl_rabbit [-] [511a12d4-04a9-4f3f-bc69-0b6739fdbf60] AMQP server on 10.222.0.13:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 21 11:53:25.012340 n-d-811414-3 nova-conductor[94357]: INFO oslo.messaging._drivers.impl_rabbit [-] [511a12d4-04a9-4f3f-bc69-0b6739fdbf60] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 49204. Apr 21 11:53:32.361536 n-d-811414-3 nova-conductor[94357]: ERROR oslo.messaging._drivers.impl_rabbit [-] [694bc511-65ea-420f-8d85-4aed262a2a29] AMQP server on 10.222.0.13:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 21 11:53:33.376721 n-d-811414-3 nova-conductor[94357]: INFO oslo.messaging._drivers.impl_rabbit [-] [694bc511-65ea-420f-8d85-4aed262a2a29] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 49210. Apr 21 11:53:49.425947 n-d-811414-3 nova-conductor[94357]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6404cb3a-bdc9-481c-93a6-d63501b53d9b] AMQP server on 10.222.0.13:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Apr 21 11:53:50.431298 n-d-811414-3 nova-conductor[94357]: INFO oslo.messaging._drivers.impl_rabbit [-] [6404cb3a-bdc9-481c-93a6-d63501b53d9b] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 49214. Apr 21 11:53:51.566872 n-d-811414-3 nova-conductor[94357]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 21 11:53:54.200079 n-d-811414-3 nova-conductor[94358]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f60095b5-b68f-459e-af9a-3776dcd48c13] AMQP server on 10.222.0.13:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Apr 21 11:53:55.207352 n-d-811414-3 nova-conductor[94358]: INFO oslo.messaging._drivers.impl_rabbit [-] [f60095b5-b68f-459e-af9a-3776dcd48c13] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 49218. Apr 21 11:54:34.374544 n-d-811414-3 nova-conductor[94358]: ERROR oslo.messaging._drivers.impl_rabbit [-] [764b4c1f-4a95-4767-989c-d3f562ce3759] AMQP server on 10.222.0.13:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 21 11:54:35.386628 n-d-811414-3 nova-conductor[94358]: INFO oslo.messaging._drivers.impl_rabbit [-] [764b4c1f-4a95-4767-989c-d3f562ce3759] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 49224. Apr 21 11:54:38.503285 n-d-811414-3 nova-conductor[94358]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 21 11:54:52.398507 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-8ffbf743-789c-4df5-80e1-a4da708ee9a6 tempest-TestShelveInstance-1316874115 tempest-TestShelveInstance-1316874115-project] Targeting cell 6c99d8ec-fb48-48af-b02b-a629a7c2cb6b(cell1) for conductor method unshelve_instance {{(pid=94357) wrapper /opt/stack/nova/nova/conductor/manager.py:91}} Apr 21 11:54:52.398995 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-8ffbf743-789c-4df5-80e1-a4da708ee9a6 tempest-TestShelveInstance-1316874115 tempest-TestShelveInstance-1316874115-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:54:52.399386 n-d-811414-3 nova-conductor[94357]: DEBUG oslo_concurrency.lockutils [None req-8ffbf743-789c-4df5-80e1-a4da708ee9a6 tempest-TestShelveInstance-1316874115 tempest-TestShelveInstance-1316874115-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:54:52.492326 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-8ffbf743-789c-4df5-80e1-a4da708ee9a6 tempest-TestShelveInstance-1316874115 tempest-TestShelveInstance-1316874115-project] [instance: e22cb8c5-9307-4261-8f1b-f582770d589d] Requesting cell 6c99d8ec-fb48-48af-b02b-a629a7c2cb6b(cell1) during scheduling {{(pid=94357) _restrict_request_spec_to_cell /opt/stack/nova/nova/conductor/manager.py:902}} Apr 21 11:54:52.804737 n-d-811414-3 nova-conductor[94357]: DEBUG nova.conductor.manager [None req-8ffbf743-789c-4df5-80e1-a4da708ee9a6 tempest-TestShelveInstance-1316874115 tempest-TestShelveInstance-1316874115-project] Took 0.31 seconds to select destinations for 1 instance(s). {{(pid=94357) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 21 11:54:52.812446 n-d-811414-3 nova-conductor[94357]: DEBUG nova.objects.instance [None req-8ffbf743-789c-4df5-80e1-a4da708ee9a6 tempest-TestShelveInstance-1316874115 tempest-TestShelveInstance-1316874115-project] Lazy-loading 'flavor' on Instance uuid e22cb8c5-9307-4261-8f1b-f582770d589d {{(pid=94357) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Apr 21 11:54:58.570615 n-d-811414-3 nova-conductor[94358]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 21 11:55:01.245938 n-d-811414-3 nova-conductor[94358]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 21 11:55:23.535754 n-d-811414-3 nova-conductor[94358]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f74a9f7c-07ff-404c-aef6-df527a438fd3] AMQP server on 10.222.0.13:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 21 11:55:24.542905 n-d-811414-3 nova-conductor[94358]: INFO oslo.messaging._drivers.impl_rabbit [-] [f74a9f7c-07ff-404c-aef6-df527a438fd3] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 49322. Apr 21 11:56:50.432415 n-d-811414-3 nova-conductor[94357]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6404cb3a-bdc9-481c-93a6-d63501b53d9b] AMQP server on 10.222.0.13:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Apr 21 11:56:51.440678 n-d-811414-3 nova-conductor[94357]: INFO oslo.messaging._drivers.impl_rabbit [-] [6404cb3a-bdc9-481c-93a6-d63501b53d9b] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 49486. Apr 21 11:56:54.437000 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-319da49b-2b4e-4b6b-ba3c-e32124cdbb4b tempest-TestSnapshotPattern-1711525545 tempest-TestSnapshotPattern-1711525545-project] Took 0.40 seconds to select destinations for 1 instance(s). {{(pid=94358) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 21 11:56:54.459855 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-319da49b-2b4e-4b6b-ba3c-e32124cdbb4b tempest-TestSnapshotPattern-1711525545 tempest-TestSnapshotPattern-1711525545-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:56:54.460257 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-319da49b-2b4e-4b6b-ba3c-e32124cdbb4b tempest-TestSnapshotPattern-1711525545 tempest-TestSnapshotPattern-1711525545-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:56:54.508687 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-319da49b-2b4e-4b6b-ba3c-e32124cdbb4b tempest-TestSnapshotPattern-1711525545 tempest-TestSnapshotPattern-1711525545-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:56:54.509012 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-319da49b-2b4e-4b6b-ba3c-e32124cdbb4b tempest-TestSnapshotPattern-1711525545 tempest-TestSnapshotPattern-1711525545-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:56:54.509759 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-319da49b-2b4e-4b6b-ba3c-e32124cdbb4b tempest-TestSnapshotPattern-1711525545 tempest-TestSnapshotPattern-1711525545-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:56:54.510146 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-319da49b-2b4e-4b6b-ba3c-e32124cdbb4b tempest-TestSnapshotPattern-1711525545 tempest-TestSnapshotPattern-1711525545-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:56:54.525196 n-d-811414-3 nova-conductor[94358]: DEBUG nova.quota [None req-319da49b-2b4e-4b6b-ba3c-e32124cdbb4b tempest-TestSnapshotPattern-1711525545 tempest-TestSnapshotPattern-1711525545-project] Getting quotas for project 13d1a82ee528488488097862b35fc4ef. Resources: {'instances', 'cores', 'ram'} {{(pid=94358) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 21 11:56:54.530363 n-d-811414-3 nova-conductor[94358]: DEBUG nova.quota [None req-319da49b-2b4e-4b6b-ba3c-e32124cdbb4b tempest-TestSnapshotPattern-1711525545 tempest-TestSnapshotPattern-1711525545-project] Getting quotas for user 13214c9ec71b406e95e4b72ce5784ad2 and project 13d1a82ee528488488097862b35fc4ef. Resources: {'instances', 'cores', 'ram'} {{(pid=94358) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 21 11:56:54.540586 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-319da49b-2b4e-4b6b-ba3c-e32124cdbb4b tempest-TestSnapshotPattern-1711525545 tempest-TestSnapshotPattern-1711525545-project] [instance: 1515fb08-ddc0-4012-b37b-df1c84c9c951] Selected host: n-h1-811414-3; Selected node: n-h1-811414-3; Alternates: [('n-h2-811414-3', 'n-h2-811414-3')] {{(pid=94358) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 21 11:56:54.541465 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-319da49b-2b4e-4b6b-ba3c-e32124cdbb4b tempest-TestSnapshotPattern-1711525545 tempest-TestSnapshotPattern-1711525545-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:56:54.541859 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-319da49b-2b4e-4b6b-ba3c-e32124cdbb4b tempest-TestSnapshotPattern-1711525545 tempest-TestSnapshotPattern-1711525545-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:56:54.548689 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-319da49b-2b4e-4b6b-ba3c-e32124cdbb4b tempest-TestSnapshotPattern-1711525545 tempest-TestSnapshotPattern-1711525545-project] [instance: 1515fb08-ddc0-4012-b37b-df1c84c9c951] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f5cdc3d5-9524-4220-a7fc-ab5606975fdb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94358) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 21 11:56:54.549840 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-319da49b-2b4e-4b6b-ba3c-e32124cdbb4b tempest-TestSnapshotPattern-1711525545 tempest-TestSnapshotPattern-1711525545-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:56:54.550494 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-319da49b-2b4e-4b6b-ba3c-e32124cdbb4b tempest-TestSnapshotPattern-1711525545 tempest-TestSnapshotPattern-1711525545-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:56:54.576803 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-319da49b-2b4e-4b6b-ba3c-e32124cdbb4b tempest-TestSnapshotPattern-1711525545 tempest-TestSnapshotPattern-1711525545-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:56:54.577206 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-319da49b-2b4e-4b6b-ba3c-e32124cdbb4b tempest-TestSnapshotPattern-1711525545 tempest-TestSnapshotPattern-1711525545-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:56:55.208410 n-d-811414-3 nova-conductor[94358]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f60095b5-b68f-459e-af9a-3776dcd48c13] AMQP server on 10.222.0.13:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Apr 21 11:56:56.218141 n-d-811414-3 nova-conductor[94358]: INFO oslo.messaging._drivers.impl_rabbit [-] [f60095b5-b68f-459e-af9a-3776dcd48c13] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 49548. Apr 21 11:57:11.574975 n-d-811414-3 nova-conductor[94357]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 21 11:57:25.014519 n-d-811414-3 nova-conductor[94357]: ERROR oslo.messaging._drivers.impl_rabbit [-] [511a12d4-04a9-4f3f-bc69-0b6739fdbf60] AMQP server on 10.222.0.13:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 21 11:57:26.022054 n-d-811414-3 nova-conductor[94357]: INFO oslo.messaging._drivers.impl_rabbit [-] [511a12d4-04a9-4f3f-bc69-0b6739fdbf60] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 49600. Apr 21 11:57:33.372903 n-d-811414-3 nova-conductor[94357]: ERROR oslo.messaging._drivers.impl_rabbit [-] [694bc511-65ea-420f-8d85-4aed262a2a29] AMQP server on 10.222.0.13:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 21 11:57:34.386299 n-d-811414-3 nova-conductor[94357]: INFO oslo.messaging._drivers.impl_rabbit [-] [694bc511-65ea-420f-8d85-4aed262a2a29] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 49606. Apr 21 11:57:58.511979 n-d-811414-3 nova-conductor[94358]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 21 11:59:16.820581 n-d-811414-3 nova-conductor[94358]: ERROR oslo.messaging._drivers.impl_rabbit [None req-0783ccad-1069-4a29-859e-7f18b11b0966 tempest-TestSnapshotPattern-1711525545 tempest-TestSnapshotPattern-1711525545-project] [f7b2aefb-014a-40d5-af97-f05178165f43] AMQP server on 10.222.0.13:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Apr 21 11:59:17.827176 n-d-811414-3 nova-conductor[94358]: INFO oslo.messaging._drivers.impl_rabbit [None req-0783ccad-1069-4a29-859e-7f18b11b0966 tempest-TestSnapshotPattern-1711525545 tempest-TestSnapshotPattern-1711525545-project] [f7b2aefb-014a-40d5-af97-f05178165f43] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 49778. Apr 21 11:59:20.043915 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-0783ccad-1069-4a29-859e-7f18b11b0966 tempest-TestSnapshotPattern-1711525545 tempest-TestSnapshotPattern-1711525545-project] Took 3.23 seconds to select destinations for 1 instance(s). {{(pid=94358) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 21 11:59:20.066395 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-0783ccad-1069-4a29-859e-7f18b11b0966 tempest-TestSnapshotPattern-1711525545 tempest-TestSnapshotPattern-1711525545-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:59:20.066790 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-0783ccad-1069-4a29-859e-7f18b11b0966 tempest-TestSnapshotPattern-1711525545 tempest-TestSnapshotPattern-1711525545-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:59:20.127053 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-0783ccad-1069-4a29-859e-7f18b11b0966 tempest-TestSnapshotPattern-1711525545 tempest-TestSnapshotPattern-1711525545-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:59:20.127567 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-0783ccad-1069-4a29-859e-7f18b11b0966 tempest-TestSnapshotPattern-1711525545 tempest-TestSnapshotPattern-1711525545-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:59:20.128377 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-0783ccad-1069-4a29-859e-7f18b11b0966 tempest-TestSnapshotPattern-1711525545 tempest-TestSnapshotPattern-1711525545-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:59:20.128874 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-0783ccad-1069-4a29-859e-7f18b11b0966 tempest-TestSnapshotPattern-1711525545 tempest-TestSnapshotPattern-1711525545-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:59:20.145066 n-d-811414-3 nova-conductor[94358]: DEBUG nova.quota [None req-0783ccad-1069-4a29-859e-7f18b11b0966 tempest-TestSnapshotPattern-1711525545 tempest-TestSnapshotPattern-1711525545-project] Getting quotas for project 13d1a82ee528488488097862b35fc4ef. Resources: {'instances', 'cores', 'ram'} {{(pid=94358) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 21 11:59:20.149535 n-d-811414-3 nova-conductor[94358]: DEBUG nova.quota [None req-0783ccad-1069-4a29-859e-7f18b11b0966 tempest-TestSnapshotPattern-1711525545 tempest-TestSnapshotPattern-1711525545-project] Getting quotas for user 13214c9ec71b406e95e4b72ce5784ad2 and project 13d1a82ee528488488097862b35fc4ef. Resources: {'instances', 'cores', 'ram'} {{(pid=94358) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 21 11:59:20.160758 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-0783ccad-1069-4a29-859e-7f18b11b0966 tempest-TestSnapshotPattern-1711525545 tempest-TestSnapshotPattern-1711525545-project] [instance: fc7dd659-4dd5-4768-9441-cc48bbdba8fb] Selected host: n-h2-811414-3; Selected node: n-h2-811414-3; Alternates: [('n-h1-811414-3', 'n-h1-811414-3')] {{(pid=94358) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 21 11:59:20.160883 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-0783ccad-1069-4a29-859e-7f18b11b0966 tempest-TestSnapshotPattern-1711525545 tempest-TestSnapshotPattern-1711525545-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:59:20.161273 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-0783ccad-1069-4a29-859e-7f18b11b0966 tempest-TestSnapshotPattern-1711525545 tempest-TestSnapshotPattern-1711525545-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:59:20.167555 n-d-811414-3 nova-conductor[94358]: DEBUG nova.conductor.manager [None req-0783ccad-1069-4a29-859e-7f18b11b0966 tempest-TestSnapshotPattern-1711525545 tempest-TestSnapshotPattern-1711525545-project] [instance: fc7dd659-4dd5-4768-9441-cc48bbdba8fb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a57e022e-2122-4eb4-b114-18a119c3d3dc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94358) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 21 11:59:20.168796 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-0783ccad-1069-4a29-859e-7f18b11b0966 tempest-TestSnapshotPattern-1711525545 tempest-TestSnapshotPattern-1711525545-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:59:20.169189 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-0783ccad-1069-4a29-859e-7f18b11b0966 tempest-TestSnapshotPattern-1711525545 tempest-TestSnapshotPattern-1711525545-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:59:20.198248 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-0783ccad-1069-4a29-859e-7f18b11b0966 tempest-TestSnapshotPattern-1711525545 tempest-TestSnapshotPattern-1711525545-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 21 11:59:20.198653 n-d-811414-3 nova-conductor[94358]: DEBUG oslo_concurrency.lockutils [None req-0783ccad-1069-4a29-859e-7f18b11b0966 tempest-TestSnapshotPattern-1711525545 tempest-TestSnapshotPattern-1711525545-project] Lock "6c99d8ec-fb48-48af-b02b-a629a7c2cb6b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 21 11:59:20.207809 n-d-811414-3 nova-conductor[94358]: ERROR oslo.messaging._drivers.impl_rabbit [None req-0783ccad-1069-4a29-859e-7f18b11b0966 tempest-TestSnapshotPattern-1711525545 tempest-TestSnapshotPattern-1711525545-project] [f80e07dc-9266-427a-8cf4-b37bba204224] AMQP server on 10.222.0.13:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Apr 21 11:59:21.215293 n-d-811414-3 nova-conductor[94358]: INFO oslo.messaging._drivers.impl_rabbit [None req-0783ccad-1069-4a29-859e-7f18b11b0966 tempest-TestSnapshotPattern-1711525545 tempest-TestSnapshotPattern-1711525545-project] [f80e07dc-9266-427a-8cf4-b37bba204224] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 49800. Apr 21 11:59:51.441085 n-d-811414-3 nova-conductor[94357]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6404cb3a-bdc9-481c-93a6-d63501b53d9b] AMQP server on 10.222.0.13:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Apr 21 11:59:52.449847 n-d-811414-3 nova-conductor[94357]: INFO oslo.messaging._drivers.impl_rabbit [-] [6404cb3a-bdc9-481c-93a6-d63501b53d9b] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 49878. Apr 21 11:59:56.219438 n-d-811414-3 nova-conductor[94358]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f60095b5-b68f-459e-af9a-3776dcd48c13] AMQP server on 10.222.0.13:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Apr 21 11:59:57.227536 n-d-811414-3 nova-conductor[94358]: INFO oslo.messaging._drivers.impl_rabbit [-] [f60095b5-b68f-459e-af9a-3776dcd48c13] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 49886. Apr 21 12:00:01.069810 n-d-811414-3 nova-conductor[94357]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 21 12:00:02.316688 n-d-811414-3 nova-conductor[94357]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 21 12:00:26.023759 n-d-811414-3 nova-conductor[94357]: ERROR oslo.messaging._drivers.impl_rabbit [-] [511a12d4-04a9-4f3f-bc69-0b6739fdbf60] AMQP server on 10.222.0.13:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 21 12:00:27.032019 n-d-811414-3 nova-conductor[94357]: INFO oslo.messaging._drivers.impl_rabbit [-] [511a12d4-04a9-4f3f-bc69-0b6739fdbf60] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 49904. Apr 21 12:00:31.582665 n-d-811414-3 nova-conductor[94357]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 21 12:00:34.381356 n-d-811414-3 nova-conductor[94357]: ERROR oslo.messaging._drivers.impl_rabbit [-] [694bc511-65ea-420f-8d85-4aed262a2a29] AMQP server on 10.222.0.13:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 21 12:00:35.393981 n-d-811414-3 nova-conductor[94357]: INFO oslo.messaging._drivers.impl_rabbit [-] [694bc511-65ea-420f-8d85-4aed262a2a29] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 49910. Apr 21 12:01:18.519215 n-d-811414-3 nova-conductor[94358]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 21 12:01:24.547679 n-d-811414-3 nova-conductor[94358]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f74a9f7c-07ff-404c-aef6-df527a438fd3] AMQP server on 10.222.0.13:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 21 12:01:25.555577 n-d-811414-3 nova-conductor[94358]: INFO oslo.messaging._drivers.impl_rabbit [-] [f74a9f7c-07ff-404c-aef6-df527a438fd3] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 50142. Apr 21 12:01:35.388644 n-d-811414-3 nova-conductor[94358]: ERROR oslo.messaging._drivers.impl_rabbit [-] [764b4c1f-4a95-4767-989c-d3f562ce3759] AMQP server on 10.222.0.13:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 21 12:01:36.403629 n-d-811414-3 nova-conductor[94358]: INFO oslo.messaging._drivers.impl_rabbit [-] [764b4c1f-4a95-4767-989c-d3f562ce3759] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 50182. Apr 21 12:02:52.450856 n-d-811414-3 nova-conductor[94357]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6404cb3a-bdc9-481c-93a6-d63501b53d9b] AMQP server on 10.222.0.13:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 21 12:02:53.459544 n-d-811414-3 nova-conductor[94357]: INFO oslo.messaging._drivers.impl_rabbit [-] [6404cb3a-bdc9-481c-93a6-d63501b53d9b] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 50228. Apr 21 12:02:57.229141 n-d-811414-3 nova-conductor[94358]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f60095b5-b68f-459e-af9a-3776dcd48c13] AMQP server on 10.222.0.13:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 21 12:02:58.236824 n-d-811414-3 nova-conductor[94358]: INFO oslo.messaging._drivers.impl_rabbit [-] [f60095b5-b68f-459e-af9a-3776dcd48c13] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 50230. Apr 21 12:03:21.077808 n-d-811414-3 nova-conductor[94357]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 21 12:03:22.324572 n-d-811414-3 nova-conductor[94357]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 21 12:03:27.032560 n-d-811414-3 nova-conductor[94357]: ERROR oslo.messaging._drivers.impl_rabbit [-] [511a12d4-04a9-4f3f-bc69-0b6739fdbf60] AMQP server on 10.222.0.13:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 21 12:03:28.039722 n-d-811414-3 nova-conductor[94357]: INFO oslo.messaging._drivers.impl_rabbit [-] [511a12d4-04a9-4f3f-bc69-0b6739fdbf60] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 50242. Apr 21 12:03:35.390380 n-d-811414-3 nova-conductor[94357]: ERROR oslo.messaging._drivers.impl_rabbit [-] [694bc511-65ea-420f-8d85-4aed262a2a29] AMQP server on 10.222.0.13:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 21 12:03:36.404319 n-d-811414-3 nova-conductor[94357]: INFO oslo.messaging._drivers.impl_rabbit [-] [694bc511-65ea-420f-8d85-4aed262a2a29] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 50248. Apr 21 12:03:51.589848 n-d-811414-3 nova-conductor[94357]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 21 12:04:25.556582 n-d-811414-3 nova-conductor[94358]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f74a9f7c-07ff-404c-aef6-df527a438fd3] AMQP server on 10.222.0.13:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 21 12:04:26.564835 n-d-811414-3 nova-conductor[94358]: INFO oslo.messaging._drivers.impl_rabbit [-] [f74a9f7c-07ff-404c-aef6-df527a438fd3] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 50256. Apr 21 12:04:36.398749 n-d-811414-3 nova-conductor[94358]: ERROR oslo.messaging._drivers.impl_rabbit [-] [764b4c1f-4a95-4767-989c-d3f562ce3759] AMQP server on 10.222.0.13:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 21 12:04:37.412099 n-d-811414-3 nova-conductor[94358]: INFO oslo.messaging._drivers.impl_rabbit [-] [764b4c1f-4a95-4767-989c-d3f562ce3759] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 50260. Apr 21 12:04:38.528681 n-d-811414-3 nova-conductor[94358]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 21 12:04:58.584904 n-d-811414-3 nova-conductor[94358]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 21 12:05:01.260159 n-d-811414-3 nova-conductor[94358]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 21 12:05:53.460161 n-d-811414-3 nova-conductor[94357]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6404cb3a-bdc9-481c-93a6-d63501b53d9b] AMQP server on 10.222.0.13:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Apr 21 12:05:54.467636 n-d-811414-3 nova-conductor[94357]: INFO oslo.messaging._drivers.impl_rabbit [-] [6404cb3a-bdc9-481c-93a6-d63501b53d9b] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 50278. Apr 21 12:05:58.238199 n-d-811414-3 nova-conductor[94358]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f60095b5-b68f-459e-af9a-3776dcd48c13] AMQP server on 10.222.0.13:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Apr 21 12:05:59.247193 n-d-811414-3 nova-conductor[94358]: INFO oslo.messaging._drivers.impl_rabbit [-] [f60095b5-b68f-459e-af9a-3776dcd48c13] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 50280. Apr 21 12:06:28.042298 n-d-811414-3 nova-conductor[94357]: ERROR oslo.messaging._drivers.impl_rabbit [-] [511a12d4-04a9-4f3f-bc69-0b6739fdbf60] AMQP server on 10.222.0.13:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Apr 21 12:06:29.049862 n-d-811414-3 nova-conductor[94357]: INFO oslo.messaging._drivers.impl_rabbit [-] [511a12d4-04a9-4f3f-bc69-0b6739fdbf60] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 50282. Apr 21 12:06:36.398133 n-d-811414-3 nova-conductor[94357]: ERROR oslo.messaging._drivers.impl_rabbit [-] [694bc511-65ea-420f-8d85-4aed262a2a29] AMQP server on 10.222.0.13:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Apr 21 12:06:37.410847 n-d-811414-3 nova-conductor[94357]: INFO oslo.messaging._drivers.impl_rabbit [-] [694bc511-65ea-420f-8d85-4aed262a2a29] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 50288. Apr 21 12:06:41.086535 n-d-811414-3 nova-conductor[94357]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 21 12:06:42.334762 n-d-811414-3 nova-conductor[94357]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 21 12:07:11.597209 n-d-811414-3 nova-conductor[94357]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 21 12:07:26.566047 n-d-811414-3 nova-conductor[94358]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f74a9f7c-07ff-404c-aef6-df527a438fd3] AMQP server on 10.222.0.13:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 21 12:07:27.573716 n-d-811414-3 nova-conductor[94358]: INFO oslo.messaging._drivers.impl_rabbit [-] [f74a9f7c-07ff-404c-aef6-df527a438fd3] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 50306. Apr 21 12:07:37.407999 n-d-811414-3 nova-conductor[94358]: ERROR oslo.messaging._drivers.impl_rabbit [-] [764b4c1f-4a95-4767-989c-d3f562ce3759] AMQP server on 10.222.0.13:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 21 12:07:38.420469 n-d-811414-3 nova-conductor[94358]: INFO oslo.messaging._drivers.impl_rabbit [-] [764b4c1f-4a95-4767-989c-d3f562ce3759] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 50310. Apr 21 12:07:58.537907 n-d-811414-3 nova-conductor[94358]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 21 12:08:18.592440 n-d-811414-3 nova-conductor[94358]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 21 12:08:21.267176 n-d-811414-3 nova-conductor[94358]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 21 12:08:54.468183 n-d-811414-3 nova-conductor[94357]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6404cb3a-bdc9-481c-93a6-d63501b53d9b] AMQP server on 10.222.0.13:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Apr 21 12:08:55.475301 n-d-811414-3 nova-conductor[94357]: INFO oslo.messaging._drivers.impl_rabbit [-] [6404cb3a-bdc9-481c-93a6-d63501b53d9b] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 50328. Apr 21 12:08:59.247263 n-d-811414-3 nova-conductor[94358]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f60095b5-b68f-459e-af9a-3776dcd48c13] AMQP server on 10.222.0.13:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Apr 21 12:09:00.255335 n-d-811414-3 nova-conductor[94358]: INFO oslo.messaging._drivers.impl_rabbit [-] [f60095b5-b68f-459e-af9a-3776dcd48c13] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 50332. Apr 21 12:09:29.051596 n-d-811414-3 nova-conductor[94357]: ERROR oslo.messaging._drivers.impl_rabbit [-] [511a12d4-04a9-4f3f-bc69-0b6739fdbf60] AMQP server on 10.222.0.13:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 21 12:09:30.059320 n-d-811414-3 nova-conductor[94357]: INFO oslo.messaging._drivers.impl_rabbit [-] [511a12d4-04a9-4f3f-bc69-0b6739fdbf60] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 50334. Apr 21 12:09:37.407404 n-d-811414-3 nova-conductor[94357]: ERROR oslo.messaging._drivers.impl_rabbit [-] [694bc511-65ea-420f-8d85-4aed262a2a29] AMQP server on 10.222.0.13:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 21 12:09:38.419672 n-d-811414-3 nova-conductor[94357]: INFO oslo.messaging._drivers.impl_rabbit [-] [694bc511-65ea-420f-8d85-4aed262a2a29] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 50338. Apr 21 12:10:01.095014 n-d-811414-3 nova-conductor[94357]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 21 12:10:02.344599 n-d-811414-3 nova-conductor[94357]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer