-- Logs begin at Fri 2021-05-28 12:48:45 UTC, end at Fri 2021-05-28 15:43:09 UTC. -- May 28 13:21:18.734438 n-d-791503-6 systemd[1]: Started Devstack devstack@n-super-cond.service. May 28 13:21:22.217468 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_db.sqlalchemy.engines [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=97976) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 28 13:21:22.446907 n-d-791503-6 nova-conductor[97976]: DEBUG nova.context [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),b241212c-c279-4fbb-a1e7-b87889287cbf(cell1) {{(pid=97976) load_cells /opt/stack/nova/nova/context.py:464}} May 28 13:21:22.450554 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_concurrency.lockutils [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:21:22.452202 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_concurrency.lockutils [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=97976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:21:22.453044 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_concurrency.lockutils [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:21:22.454910 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_concurrency.lockutils [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=97976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:21:22.481744 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_db.sqlalchemy.engines [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=97976) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 28 13:21:22.488972 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_db.sqlalchemy.engines [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=97976) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 28 13:21:22.497039 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_concurrency.lockutils [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] Acquired lock "singleton_lock" {{(pid=97976) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:266}} May 28 13:21:22.497542 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_concurrency.lockutils [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] Releasing lock "singleton_lock" {{(pid=97976) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:282}} May 28 13:21:22.498262 n-d-791503-6 nova-conductor[97976]: INFO oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] Starting 2 workers May 28 13:21:22.502911 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] Started child 98843 {{(pid=97976) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:576}} May 28 13:21:22.508337 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] Started child 98844 {{(pid=97976) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:576}} May 28 13:21:22.509435 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] Full set of CONF: {{(pid=97976) wait /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:650}} May 28 13:21:22.509836 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] ******************************************************************************** {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 28 13:21:22.510170 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] Configuration options gathered from: {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 28 13:21:22.510566 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] command line args: ['--config-file', '/etc/nova/nova.conf'] {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 28 13:21:22.511168 n-d-791503-6 nova-conductor[98843]: INFO nova.service [-] Starting conductor node (version 23.1.0) May 28 13:21:22.511650 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] config files: ['/etc/nova/nova.conf'] {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 28 13:21:22.511650 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] ================================================================================ {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 28 13:21:22.512379 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] allow_resize_to_same_host = True {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 13:21:22.512891 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] arq_binding_timeout = 300 {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 13:21:22.513335 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] block_device_allocate_retries = 60 {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 13:21:22.513768 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] block_device_allocate_retries_interval = 3 {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 13:21:22.514224 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] cert = self.pem {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 13:21:22.514657 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] compute_driver = None {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 13:21:22.515172 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] compute_monitors = [] {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 13:21:22.515613 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] config_dir = [] {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 13:21:22.516082 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] config_drive_format = iso9660 {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 13:21:22.516411 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] config_file = ['/etc/nova/nova.conf'] {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 13:21:22.516824 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] config_source = [] {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 13:21:22.517259 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] console_host = n-d-791503-6 {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 13:21:22.517685 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] control_exchange = nova {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 13:21:22.518129 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] cpu_allocation_ratio = None {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 13:21:22.518537 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] daemon = False {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 13:21:22.518980 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] debug = True {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 13:21:22.526387 n-d-791503-6 nova-conductor[98844]: INFO nova.service [-] Starting conductor node (version 23.1.0) May 28 13:21:22.535372 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] default_access_ip_network_name = None {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 13:21:22.535941 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] default_availability_zone = nova {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 13:21:22.536359 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] default_ephemeral_format = None {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 13:21:22.536995 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 13:21:22.537621 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] default_schedule_zone = None {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 13:21:22.539583 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] disk_allocation_ratio = None {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 13:21:22.539583 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] enable_new_services = True {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 13:21:22.539583 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] enabled_apis = ['osapi_compute'] {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 13:21:22.539583 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] enabled_ssl_apis = [] {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 13:21:22.539892 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] flat_injected = False {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 13:21:22.540104 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] force_config_drive = True {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 13:21:22.540511 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] force_raw_images = True {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 13:21:22.540920 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] graceful_shutdown_timeout = 5 {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 13:21:22.541365 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] heal_instance_info_cache_interval = 60 {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 13:21:22.542075 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] host = n-d-791503-6 {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 13:21:22.542532 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] initial_cpu_allocation_ratio = 16.0 {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 13:21:22.542898 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] initial_disk_allocation_ratio = 1.0 {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 13:21:22.543328 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] initial_ram_allocation_ratio = 1.5 {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 13:21:22.544467 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 13:21:22.544467 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] instance_build_timeout = 0 {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 13:21:22.544636 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] instance_delete_interval = 300 {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 13:21:22.545039 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] instance_format = [instance: %(uuid)s] {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 13:21:22.545431 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] instance_name_template = instance-%08x {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 13:21:22.545840 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] instance_usage_audit = False {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 13:21:22.546262 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] instance_usage_audit_period = month {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 13:21:22.546654 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 13:21:22.547086 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] instances_path = /opt/stack/data/nova/instances {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 13:21:22.547489 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] internal_service_availability_zone = internal {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 13:21:22.547860 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] key = None {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 13:21:22.548238 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] live_migration_retry_count = 30 {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 13:21:22.548863 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] log_config_append = None {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 13:21:22.549291 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 13:21:22.549703 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] log_dir = None {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 13:21:22.550087 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] log_file = None {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 13:21:22.550655 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] log_options = True {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 13:21:22.551052 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] log_rotate_interval = 1 {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 13:21:22.551502 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] log_rotate_interval_type = days {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 13:21:22.552276 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] log_rotation_type = none {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 13:21:22.552892 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 13:21:22.554051 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 13:21:22.554409 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 13:21:22.554832 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 13:21:22.555171 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 13:21:22.555606 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] long_rpc_timeout = 1800 {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 13:21:22.556002 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] max_concurrent_builds = 10 {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 13:21:22.556385 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] max_concurrent_live_migrations = 1 {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 13:21:22.556769 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] max_concurrent_snapshots = 5 {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 13:21:22.557201 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] max_local_block_devices = 3 {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 13:21:22.557590 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] max_logfile_count = 30 {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 13:21:22.557952 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] max_logfile_size_mb = 200 {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 13:21:22.558330 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] maximum_instance_delete_attempts = 5 {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 13:21:22.558772 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] metadata_listen = 0.0.0.0 {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 13:21:22.560825 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] metadata_listen_port = 8775 {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 13:21:22.560825 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] metadata_workers = 2 {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 13:21:22.560825 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] migrate_max_retries = -1 {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 13:21:22.560825 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] mkisofs_cmd = genisoimage {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 13:21:22.560825 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] my_block_storage_ip = 10.222.0.68 {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 13:21:22.561181 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] my_ip = 10.222.0.68 {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 13:21:22.561513 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] network_allocate_retries = 0 {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 13:21:22.561946 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 13:21:22.562340 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] osapi_compute_listen = 0.0.0.0 {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 13:21:22.562715 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] osapi_compute_listen_port = 8774 {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 13:21:22.563118 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] osapi_compute_unique_server_name_scope = {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 13:21:22.563514 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] osapi_compute_workers = 2 {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 13:21:22.563918 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_db.sqlalchemy.engines [None req-fcd6dfae-a0e4-4d87-86e5-a3b87172e2e2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=98843) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 28 13:21:22.564118 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] password_length = 12 {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 13:21:22.568187 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] periodic_enable = True {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 13:21:22.568625 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] periodic_fuzzy_delay = 60 {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 13:21:22.569731 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] pointer_model = usbtablet {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 13:21:22.570186 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] preallocate_images = none {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 13:21:22.570594 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] publish_errors = False {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 13:21:22.570926 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] pybasedir = /opt/stack/nova {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 13:21:22.573128 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] ram_allocation_ratio = None {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 13:21:22.574012 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] rate_limit_burst = 0 {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 13:21:22.574546 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] rate_limit_except_level = CRITICAL {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 13:21:22.575865 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] rate_limit_interval = 0 {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 13:21:22.576258 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] reboot_timeout = 0 {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 13:21:22.576680 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] reclaim_instance_interval = 0 {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 13:21:22.577062 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] record = None {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 13:21:22.577450 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] report_interval = 10 {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 13:21:22.577839 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] rescue_timeout = 0 {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 13:21:22.578245 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] reserved_host_cpus = 0 {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 13:21:22.578860 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] reserved_host_disk_mb = 0 {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 13:21:22.579457 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] reserved_host_memory_mb = 512 {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 13:21:22.579879 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] reserved_huge_pages = None {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 13:21:22.580461 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] resize_confirm_window = 0 {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 13:21:22.581034 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] resize_fs_using_block_device = False {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 13:21:22.581421 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] resume_guests_state_on_host_boot = False {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 13:21:22.581972 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 13:21:22.582230 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] rpc_response_timeout = 60 {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 13:21:22.582629 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] run_external_periodic_tasks = True {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 13:21:22.583019 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] running_deleted_instance_action = reap {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 13:21:22.585557 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] running_deleted_instance_poll_interval = 1800 {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 13:21:22.585994 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] running_deleted_instance_timeout = 0 {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 13:21:22.586368 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_db.sqlalchemy.engines [None req-a7667bc9-3018-458b-8c75-4c47e838be87 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=98844) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 28 13:21:22.586493 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] scheduler_instance_sync_interval = 120 {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 13:21:22.587161 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] service_down_time = 60 {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 13:21:22.587578 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] servicegroup_driver = db {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 13:21:22.588149 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] shelved_offload_time = 0 {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 13:21:22.588659 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] shelved_poll_interval = 3600 {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 13:21:22.589084 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] shutdown_timeout = 0 {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 13:21:22.589471 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] source_is_ipv6 = False {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 13:21:22.589854 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] ssl_only = False {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 13:21:22.590244 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] state_path = /opt/stack/data/nova {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 13:21:22.590643 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] sync_power_state_interval = 600 {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 13:21:22.591019 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] sync_power_state_pool_size = 1000 {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 13:21:22.591441 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] syslog_log_facility = LOG_USER {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 13:21:22.591817 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] tempdir = None {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 13:21:22.592206 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] timeout_nbd = 10 {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 13:21:22.592615 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] transport_url = **** {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 13:21:22.593191 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] update_resources_interval = 0 {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 13:21:22.593554 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] use_cow_images = True {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 13:21:22.593960 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] use_eventlog = False {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 13:21:22.594343 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] use_journal = False {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 13:21:22.594739 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] use_json = False {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 13:21:22.595137 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] use_rootwrap_daemon = False {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 13:21:22.595821 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] use_stderr = False {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 13:21:22.595928 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] use_syslog = False {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 13:21:22.596256 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] vcpu_pin_set = None {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 13:21:22.597017 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] vif_plugging_is_fatal = True {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 13:21:22.597431 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] vif_plugging_timeout = 300 {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 13:21:22.597864 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] virt_mkfs = [] {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 13:21:22.598263 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] volume_usage_poll_interval = 0 {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 13:21:22.598662 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] watch_log_file = False {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 13:21:22.599084 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] web = /usr/share/spice-html5 {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 13:21:22.599617 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] oslo_concurrency.disable_process_locking = False {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.600659 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.601140 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] api.auth_strategy = keystone {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.601547 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] api.compute_link_prefix = None {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.601970 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.602376 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] api.dhcp_domain = novalocal {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.602774 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] api.enable_instance_password = True {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.603185 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] api.glance_link_prefix = None {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.603569 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.604074 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] api.instance_list_cells_batch_strategy = distributed {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.604543 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] api.instance_list_per_project_cells = False {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.604930 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] api.list_records_by_skipping_down_cells = True {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.605329 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] api.local_metadata_per_cell = False {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.605737 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] api.max_limit = 1000 {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.606133 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] api.metadata_cache_expiration = 15 {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.606531 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] api.neutron_default_tenant_id = default {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.606918 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] api.use_forwarded_for = False {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.607373 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] api.use_neutron_default_nets = False {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.607779 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.608178 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] api.vendordata_dynamic_failure_fatal = False {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.608565 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.609121 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] api.vendordata_dynamic_ssl_certfile = {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.609651 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] api.vendordata_dynamic_targets = [] {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.610043 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] api.vendordata_jsonfile_path = None {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.610895 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] api.vendordata_providers = ['StaticJSON'] {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.611002 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] cache.backend = dogpile.cache.memcached {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.611334 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] cache.backend_argument = **** {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.611747 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] cache.config_prefix = cache.oslo {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.612150 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] cache.debug_cache_backend = False {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.612578 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] cache.enabled = True {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.613135 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] cache.expiration_time = 600 {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.613558 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] cache.memcache_dead_retry = 300 {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.613937 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.614798 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.615292 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] cache.memcache_pool_maxsize = 10 {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.616554 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.616995 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.617393 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] cache.memcache_socket_timeout = 1.0 {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.618022 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] cache.proxies = [] {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.618423 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] cache.tls_allowed_ciphers = None {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.618854 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] cache.tls_cafile = None {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.619554 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] cache.tls_certfile = None {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.619959 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] cache.tls_enabled = False {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.620415 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] cache.tls_keyfile = None {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.620908 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] cinder.auth_section = None {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.621330 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] cinder.auth_type = password {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.621725 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] cinder.cafile = None {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.622193 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] cinder.catalog_info = volumev3::publicURL {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.622591 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] cinder.certfile = None {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.623036 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] cinder.collect_timing = False {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.623448 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] cinder.cross_az_attach = True {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.623890 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] cinder.endpoint_template = None {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.624295 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] cinder.http_retries = 3 {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.624688 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] cinder.insecure = False {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.624974 n-d-791503-6 nova-conductor[98843]: DEBUG nova.service [None req-fcd6dfae-a0e4-4d87-86e5-a3b87172e2e2 None None] Creating RPC server for service conductor {{(pid=98843) start /opt/stack/nova/nova/service.py:182}} May 28 13:21:22.625155 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] cinder.keyfile = None {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.625549 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] cinder.os_region_name = RegionOne {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.625939 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] cinder.split_loggers = False {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.626365 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] cinder.timeout = None {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.626926 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.627357 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] compute.cpu_dedicated_set = None {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.627741 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] compute.cpu_shared_set = None {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.628411 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] compute.image_type_exclude_list = [] {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.628798 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] compute.live_migration_wait_for_vif_plug = True {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.629186 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] compute.max_concurrent_disk_ops = 0 {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.629591 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] compute.max_disk_devices_to_attach = -1 {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.630020 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.630445 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] compute.resource_provider_association_refresh = 300 {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.630979 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] compute.shutdown_retry_interval = 10 {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.631335 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] conductor.workers = 2 {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.631739 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] console.allowed_origins = [] {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.632116 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] console.ssl_ciphers = None {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.632564 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] console.ssl_minimum_version = default {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.632966 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] consoleauth.token_ttl = 600 {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.633391 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] cyborg.cafile = None {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.633770 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] cyborg.certfile = None {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.634151 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] cyborg.collect_timing = False {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.634574 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] cyborg.connect_retries = None {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.634973 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] cyborg.connect_retry_delay = None {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.635384 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] cyborg.endpoint_override = None {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.635767 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] cyborg.insecure = False {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.636143 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] cyborg.keyfile = None {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.636519 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] cyborg.max_version = None {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.636897 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] cyborg.min_version = None {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.637269 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] cyborg.region_name = None {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.637641 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] cyborg.service_name = None {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.638033 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] cyborg.service_type = accelerator {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.638455 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] cyborg.split_loggers = False {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.638856 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] cyborg.status_code_retries = None {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.639303 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] cyborg.status_code_retry_delay = None {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.639684 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] cyborg.timeout = None {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.640118 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.640491 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] cyborg.version = None {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.640915 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] api_database.connection = **** {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.641324 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] api_database.connection_debug = 0 {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.641719 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] api_database.connection_parameters = {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.642133 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] api_database.connection_recycle_time = 3600 {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.642570 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] api_database.connection_trace = False {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.642959 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] api_database.max_overflow = None {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.643355 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] api_database.max_pool_size = None {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.643732 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] api_database.max_retries = 10 {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.644144 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] api_database.mysql_sql_mode = TRADITIONAL {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.644513 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] api_database.pool_timeout = None {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.645359 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] api_database.retry_interval = 10 {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.645359 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] api_database.slave_connection = **** {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.645620 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] api_database.sqlite_synchronous = True {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.646003 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] devices.enabled_vgpu_types = [] {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.646416 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.646909 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] ephemeral_storage_encryption.enabled = False {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.647404 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] ephemeral_storage_encryption.key_size = 512 {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.647818 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] glance.api_servers = None {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.648198 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] glance.cafile = None {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.648595 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] glance.certfile = None {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.648971 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] glance.collect_timing = False {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.649380 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] glance.connect_retries = None {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.649762 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] glance.connect_retry_delay = None {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.650161 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] glance.debug = False {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.650540 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] glance.default_trusted_certificate_ids = [] {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.651089 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] glance.enable_certificate_validation = False {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.651384 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] glance.enable_rbd_download = False {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.651808 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] glance.endpoint_override = None {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.652189 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] glance.insecure = False {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.652572 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] glance.keyfile = None {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.653040 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] glance.max_version = None {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.653415 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] glance.min_version = None {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.653806 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] glance.num_retries = 3 {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.654263 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] glance.rbd_ceph_conf = {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.654644 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] glance.rbd_connect_timeout = 5 {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.655039 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] glance.rbd_pool = {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.655452 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] glance.rbd_user = {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.655839 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] glance.region_name = None {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.656250 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] glance.service_name = None {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.656647 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] glance.service_type = image {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.657073 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] glance.split_loggers = False {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.657471 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] glance.status_code_retries = None {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.657844 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] glance.status_code_retry_delay = None {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.658267 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] glance.timeout = None {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.658678 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] glance.valid_interfaces = ['internal', 'public'] {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.659053 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] glance.verify_glance_signatures = False {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.659487 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] glance.version = None {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.659891 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] guestfs.debug = False {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.660316 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] hyperv.config_drive_cdrom = False {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.660716 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] hyperv.config_drive_inject_password = False {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.661097 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] hyperv.dynamic_memory_ratio = 1.0 {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.661526 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] hyperv.enable_instance_metrics_collection = False {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.661910 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] hyperv.enable_remotefx = False {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.662323 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] hyperv.instances_path_share = {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.663391 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] hyperv.iscsi_initiator_list = [] {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.663773 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] hyperv.limit_cpu_features = False {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.664149 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.664553 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.664932 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] hyperv.power_state_check_timeframe = 60 {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.665315 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] hyperv.power_state_event_polling_interval = 2 {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.665752 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.666140 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] hyperv.use_multipath_io = False {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.666515 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] hyperv.volume_attach_retry_count = 10 {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.666900 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] hyperv.volume_attach_retry_interval = 5 {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.667318 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] hyperv.vswitch_name = None {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.667747 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.668142 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] mks.enabled = False {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.669184 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.669586 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] image_cache.manager_interval = 2400 {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.669982 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] image_cache.precache_concurrency = 1 {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.670372 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] image_cache.remove_unused_base_images = True {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.670783 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.671224 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.671676 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] image_cache.subdirectory_name = _base {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.672104 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] ironic.api_max_retries = 60 {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.672488 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] ironic.api_retry_interval = 2 {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.672885 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] ironic.auth_section = None {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.673264 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] ironic.auth_type = None {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.673646 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] ironic.cafile = None {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.674027 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] ironic.certfile = None {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.674406 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] ironic.collect_timing = False {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.674794 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] ironic.connect_retries = None {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.675299 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] ironic.connect_retry_delay = None {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.675976 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] ironic.endpoint_override = None {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.676383 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] ironic.insecure = False {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.676760 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] ironic.keyfile = None {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.677132 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] ironic.max_version = None {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.677504 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] ironic.min_version = None {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.677883 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] ironic.partition_key = None {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.678876 n-d-791503-6 nova-conductor[98844]: DEBUG nova.service [None req-a7667bc9-3018-458b-8c75-4c47e838be87 None None] Creating RPC server for service conductor {{(pid=98844) start /opt/stack/nova/nova/service.py:182}} May 28 13:21:22.678983 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] ironic.peer_list = [] {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.679305 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] ironic.region_name = None {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.679734 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] ironic.serial_console_state_timeout = 10 {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.680122 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] ironic.service_name = None {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.680535 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] ironic.service_type = baremetal {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.680917 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] ironic.split_loggers = False {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.681289 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] ironic.status_code_retries = None {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.681655 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] ironic.status_code_retry_delay = None {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.682027 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] ironic.timeout = None {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.682435 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] ironic.valid_interfaces = ['internal', 'public'] {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.682807 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] ironic.version = None {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.683275 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.683703 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] key_manager.fixed_key = **** {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.684180 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.684579 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] barbican.barbican_api_version = None {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.684955 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] barbican.barbican_endpoint = None {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.685381 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] barbican.barbican_endpoint_type = public {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.685771 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] barbican.barbican_region_name = None {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.686145 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] barbican.cafile = None {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.686516 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] barbican.certfile = None {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.686890 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] barbican.collect_timing = False {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.687333 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] barbican.insecure = False {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.687706 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] barbican.keyfile = None {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.688122 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] barbican.number_of_retries = 60 {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.688501 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] barbican.retry_delay = 1 {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.689137 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] barbican.split_loggers = False {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.689534 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] barbican.timeout = None {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.689919 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] barbican.verify_ssl = True {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.690302 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] barbican.verify_ssl_path = None {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.690725 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] vault.approle_role_id = None {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.691225 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] vault.approle_secret_id = None {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.692356 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] vault.cafile = None {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.693260 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] vault.certfile = None {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.693953 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] vault.collect_timing = False {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.694356 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] vault.insecure = False {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.694744 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] vault.keyfile = None {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.695176 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] vault.kv_mountpoint = secret {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.695560 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] vault.kv_version = 2 {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.695942 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] vault.root_token_id = None {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.696323 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] vault.split_loggers = False {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.696703 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] vault.ssl_ca_crt_file = None {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.697132 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] vault.timeout = None {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.697459 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] vault.use_ssl = False {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.697869 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.698290 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] keystone.cafile = None {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.698665 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] keystone.certfile = None {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.699044 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] keystone.collect_timing = False {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.699456 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] keystone.connect_retries = None {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.699829 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] keystone.connect_retry_delay = None {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.700263 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] keystone.endpoint_override = None {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.700653 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] keystone.insecure = False {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.701073 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] keystone.keyfile = None {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.701451 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] keystone.max_version = None {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.701824 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] keystone.min_version = None {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.702255 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] keystone.region_name = None {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.702642 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] keystone.service_name = None {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.703047 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] keystone.service_type = identity {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.703497 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] keystone.split_loggers = False {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.703879 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] keystone.status_code_retries = None {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.704260 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] keystone.status_code_retry_delay = None {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.704804 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] keystone.timeout = None {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.705291 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] keystone.valid_interfaces = ['internal', 'public'] {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.705672 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] keystone.version = None {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.706135 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] libvirt.connection_uri = {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.706543 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] libvirt.cpu_mode = None {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.706942 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] libvirt.cpu_model_extra_flags = [] {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.707456 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] libvirt.cpu_models = [] {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.707868 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] libvirt.device_detach_attempts = 8 {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.708237 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] libvirt.device_detach_timeout = 20 {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.708624 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] libvirt.disk_cachemodes = [] {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.709015 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] libvirt.disk_prefix = None {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.709508 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] libvirt.enabled_perf_events = [] {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.709905 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] libvirt.file_backed_memory = 0 {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.710290 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] libvirt.gid_maps = [] {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.710682 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] libvirt.hw_disk_discard = None {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.711057 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] libvirt.hw_machine_type = None {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.711520 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] libvirt.images_rbd_ceph_conf = {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.711909 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.712312 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.712702 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] libvirt.images_rbd_glance_store_name = {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.713108 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] libvirt.images_rbd_pool = rbd {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.713522 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] libvirt.images_type = default {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.713905 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] libvirt.images_volume_group = None {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.714282 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] libvirt.inject_key = False {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.714670 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] libvirt.inject_partition = -2 {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.715087 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] libvirt.inject_password = False {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.715510 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] libvirt.iscsi_iface = None {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.715940 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] libvirt.iser_use_multipath = False {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.716344 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] libvirt.live_migration_bandwidth = 0 {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.716734 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] libvirt.live_migration_completion_timeout = 800 {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.717120 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] libvirt.live_migration_downtime = 500 {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.717502 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] libvirt.live_migration_downtime_delay = 75 {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.717886 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] libvirt.live_migration_downtime_steps = 10 {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.718263 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] libvirt.live_migration_inbound_addr = None {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.718645 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] libvirt.live_migration_permit_auto_converge = False {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.719030 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] libvirt.live_migration_permit_post_copy = False {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.719667 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] libvirt.live_migration_scheme = None {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.720081 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] libvirt.live_migration_timeout_action = abort {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.720474 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] libvirt.live_migration_tunnelled = False {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.720851 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] libvirt.live_migration_uri = None {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.721237 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] libvirt.live_migration_with_native_tls = False {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.721631 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] libvirt.max_queues = None {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.722007 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] libvirt.mem_stats_period_seconds = 10 {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.722409 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] libvirt.nfs_mount_options = None {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.722931 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.723335 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] libvirt.num_aoe_discover_tries = 3 {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.723764 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] libvirt.num_iser_scan_tries = 5 {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.724150 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] libvirt.num_memory_encrypted_guests = None {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.724528 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] libvirt.num_nvme_discover_tries = 5 {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.724906 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] libvirt.num_pcie_ports = 0 {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.725870 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] libvirt.num_volume_scan_tries = 5 {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.726256 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] libvirt.pmem_namespaces = [] {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.726634 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] libvirt.quobyte_client_cfg = None {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.727152 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.727542 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] libvirt.rbd_connect_timeout = 5 {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.727975 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.728364 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.728741 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] libvirt.rbd_secret_uuid = None {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.729117 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] libvirt.rbd_user = None {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.729491 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] libvirt.realtime_scheduler_priority = 1 {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.729910 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] libvirt.remote_filesystem_transport = ssh {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.730290 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] libvirt.rescue_image_id = None {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.730672 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] libvirt.rescue_kernel_id = None {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.731048 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] libvirt.rescue_ramdisk_id = None {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.731534 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] libvirt.rng_dev_path = /dev/urandom {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.731916 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] libvirt.rx_queue_size = None {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.732324 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] libvirt.smbfs_mount_options = {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.732807 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.733193 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] libvirt.snapshot_compression = False {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.733572 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] libvirt.snapshot_image_format = None {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.734052 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.734443 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] libvirt.sparse_logical_volumes = False {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.734823 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] libvirt.swtpm_enabled = False {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.735273 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] libvirt.swtpm_group = tss {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.735673 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] libvirt.swtpm_user = tss {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.736114 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] libvirt.sysinfo_serial = unique {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.736492 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] libvirt.tx_queue_size = None {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.736875 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] libvirt.uid_maps = [] {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.737252 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] libvirt.use_virtio_for_bridges = True {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.737653 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] libvirt.virt_type = kvm {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.738050 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] libvirt.volume_clear = zero {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.738436 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] libvirt.volume_clear_size = 0 {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.738824 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] libvirt.volume_use_multipath = False {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.739224 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] libvirt.vzstorage_cache_path = None {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.739618 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.740012 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] libvirt.vzstorage_mount_group = qemu {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.740398 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] libvirt.vzstorage_mount_opts = [] {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.741418 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] libvirt.vzstorage_mount_perms = 0770 {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.741901 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.742308 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] libvirt.vzstorage_mount_user = stack {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.742687 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.743143 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] neutron.auth_section = None {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.743533 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] neutron.auth_type = password {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.744109 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] neutron.cafile = None {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.744640 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] neutron.certfile = None {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.745173 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] neutron.collect_timing = False {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.745733 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] neutron.connect_retries = None {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.746261 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] neutron.connect_retry_delay = None {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.746811 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] neutron.default_floating_pool = public {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.747218 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] neutron.endpoint_override = None {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.747604 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] neutron.extension_sync_interval = 600 {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.748023 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] neutron.http_retries = 3 {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.748416 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] neutron.insecure = False {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.748791 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] neutron.keyfile = None {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.749165 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] neutron.max_version = None {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.749559 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] neutron.metadata_proxy_shared_secret = **** {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.749925 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] neutron.min_version = None {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.750320 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] neutron.ovs_bridge = br-int {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.750705 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] neutron.physnets = [] {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.751129 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] neutron.region_name = RegionOne {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.751524 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] neutron.service_metadata_proxy = True {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.751905 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] neutron.service_name = None {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.752304 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] neutron.service_type = network {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.752683 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] neutron.split_loggers = False {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.753055 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] neutron.status_code_retries = None {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.753437 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] neutron.status_code_retry_delay = None {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.753804 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] neutron.timeout = None {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.754213 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] neutron.valid_interfaces = ['internal', 'public'] {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.754593 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] neutron.version = None {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.754992 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] notifications.bdms_in_notifications = False {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.755407 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] notifications.default_level = INFO {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.755808 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] notifications.notification_format = unversioned {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.756180 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] notifications.notify_on_state_change = None {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.756861 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.757456 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] pci.alias = [] {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.758038 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] pci.passthrough_whitelist = [] {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.758476 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] placement.auth_section = None {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.758882 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] placement.auth_type = password {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.759310 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] placement.auth_url = http://10.222.0.68/identity {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.759690 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] placement.cafile = None {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.760066 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] placement.certfile = None {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.760447 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] placement.collect_timing = False {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.760822 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] placement.connect_retries = None {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.761196 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] placement.connect_retry_delay = None {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.761590 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] placement.default_domain_id = None {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.761964 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] placement.default_domain_name = None {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.762358 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] placement.domain_id = None {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.762732 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] placement.domain_name = None {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.763145 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] placement.endpoint_override = None {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.763531 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] placement.insecure = False {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.763909 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] placement.keyfile = None {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.764306 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] placement.max_version = None {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.764684 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] placement.min_version = None {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.765077 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] placement.password = **** {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.765477 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] placement.project_domain_id = None {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.765852 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] placement.project_domain_name = Default {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.766234 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] placement.project_id = None {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.766635 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] placement.project_name = service {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.767027 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] placement.region_name = RegionOne {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.767458 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] placement.service_name = None {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.767857 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] placement.service_type = placement {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.768251 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] placement.split_loggers = False {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.768617 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] placement.status_code_retries = None {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.768994 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] placement.status_code_retry_delay = None {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.769365 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] placement.system_scope = None {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.769739 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] placement.timeout = None {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.770119 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] placement.trust_id = None {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.770495 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] placement.user_domain_id = None {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.770883 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] placement.user_domain_name = Default {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.771281 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] placement.user_id = None {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.771980 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] placement.username = placement {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.772645 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] placement.valid_interfaces = ['internal', 'public'] {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.773250 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] placement.version = None {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.774661 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] powervm.disk_driver = localdisk {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.775607 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] powervm.proc_units_factor = 0.1 {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.776247 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] powervm.volume_group_name = {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.776888 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] quota.cores = 20 {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.777484 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] quota.count_usage_from_placement = False {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.778100 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] quota.driver = nova.quota.DbQuotaDriver {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.778727 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] quota.injected_file_content_bytes = 10240 {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.779374 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] quota.injected_file_path_length = 255 {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.779990 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] quota.injected_files = 5 {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.780614 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] quota.instances = 10 {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.781220 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] quota.key_pairs = 100 {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.781820 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] quota.metadata_items = 128 {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.782417 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] quota.ram = 51200 {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.783015 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] quota.recheck_quota = True {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.783666 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] quota.server_group_members = 10 {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.784267 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] quota.server_groups = 10 {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.784882 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] rdp.enabled = False {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.785750 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.786395 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.787094 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.788282 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] scheduler.image_metadata_prefilter = False {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.788920 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.789521 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] scheduler.max_attempts = 3 {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.790148 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] scheduler.max_placement_results = 1000 {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.790757 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.791371 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] scheduler.query_placement_for_availability_zone = False {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.791984 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] scheduler.query_placement_for_image_type_support = False {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.792582 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.793191 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] scheduler.workers = 2 {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.793843 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.794469 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.795185 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.795807 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.799536 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.800168 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.801070 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.801732 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.802346 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] filter_scheduler.host_subset_size = 1 {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.802942 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] filter_scheduler.image_properties_default_architecture = None {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.804228 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.805004 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] filter_scheduler.isolated_hosts = [] {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.805621 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] filter_scheduler.isolated_images = [] {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.806214 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] filter_scheduler.max_instances_per_host = 50 {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.806811 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.807441 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.807829 n-d-791503-6 nova-conductor[98844]: DEBUG nova.service [None req-a7667bc9-3018-458b-8c75-4c47e838be87 None None] Join ServiceGroup membership for this service conductor {{(pid=98844) start /opt/stack/nova/nova/service.py:199}} May 28 13:21:22.808278 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.808386 n-d-791503-6 nova-conductor[98844]: DEBUG nova.servicegroup.drivers.db [None req-a7667bc9-3018-458b-8c75-4c47e838be87 None None] DB_Driver: join new ServiceGroup member n-d-791503-6 to the conductor group, service = {{(pid=98844) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}} May 28 13:21:22.809003 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.809598 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.810204 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.810802 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.811573 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] filter_scheduler.track_instance_changes = False {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.812194 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.812822 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] metrics.required = True {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.813416 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] metrics.weight_multiplier = 1.0 {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.814034 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] metrics.weight_of_unavailable = -10000.0 {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.814643 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] metrics.weight_setting = [] {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.815496 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.816094 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] serial_console.enabled = False {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.816726 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] serial_console.port_range = 10000:20000 {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.817351 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.817971 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.818245 n-d-791503-6 nova-conductor[98843]: DEBUG nova.service [None req-fcd6dfae-a0e4-4d87-86e5-a3b87172e2e2 None None] Join ServiceGroup membership for this service conductor {{(pid=98843) start /opt/stack/nova/nova/service.py:199}} May 28 13:21:22.818775 n-d-791503-6 nova-conductor[98843]: DEBUG nova.servicegroup.drivers.db [None req-fcd6dfae-a0e4-4d87-86e5-a3b87172e2e2 None None] DB_Driver: join new ServiceGroup member n-d-791503-6 to the conductor group, service = {{(pid=98843) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}} May 28 13:21:22.819090 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] serial_console.serialproxy_port = 6083 {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.819886 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] service_user.auth_section = None {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.820363 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] service_user.auth_type = password {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.820821 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] service_user.cafile = None {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.821285 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] service_user.certfile = None {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.821744 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] service_user.collect_timing = False {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.822198 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] service_user.insecure = False {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.822648 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] service_user.keyfile = None {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.823149 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] service_user.send_service_user_token = True {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.823599 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] service_user.split_loggers = False {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.824042 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] service_user.timeout = None {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.824526 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] spice.agent_enabled = True {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.824976 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] spice.enabled = False {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.825671 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.826183 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] spice.html5proxy_host = 0.0.0.0 {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.826638 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] spice.html5proxy_port = 6082 {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.827137 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] spice.server_listen = 127.0.0.1 {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.827599 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.828077 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] upgrade_levels.baseapi = None {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.828562 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] upgrade_levels.cert = None {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.829016 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] upgrade_levels.compute = auto {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.829467 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] upgrade_levels.conductor = None {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.829917 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] upgrade_levels.scheduler = None {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.830373 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] vendordata_dynamic_auth.auth_section = None {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.830824 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] vendordata_dynamic_auth.auth_type = None {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.831301 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] vendordata_dynamic_auth.cafile = None {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.831740 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] vendordata_dynamic_auth.certfile = None {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.832182 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] vendordata_dynamic_auth.collect_timing = False {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.832636 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] vendordata_dynamic_auth.insecure = False {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.833078 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] vendordata_dynamic_auth.keyfile = None {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.833533 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] vendordata_dynamic_auth.split_loggers = False {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.834027 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] vendordata_dynamic_auth.timeout = None {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.834549 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] vmware.api_retry_count = 10 {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.835003 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] vmware.ca_file = None {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.835738 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] vmware.cache_prefix = None {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.835945 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] vmware.cluster_name = None {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.836354 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] vmware.connection_pool_size = 10 {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.836954 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] vmware.console_delay_seconds = None {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.837535 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] vmware.datastore_regex = None {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.837919 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] vmware.host_ip = None {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.838351 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] vmware.host_password = **** {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.838675 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] vmware.host_port = 443 {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.839061 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] vmware.host_username = None {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.839462 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] vmware.insecure = False {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.839863 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] vmware.integration_bridge = None {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.840247 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] vmware.maximum_objects = 100 {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.840625 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] vmware.pbm_default_policy = None {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.841024 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] vmware.pbm_enabled = False {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.841430 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] vmware.pbm_wsdl_location = None {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.841823 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.842203 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] vmware.serial_port_proxy_uri = None {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.842575 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] vmware.serial_port_service_uri = None {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.842970 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] vmware.task_poll_interval = 0.5 {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.843385 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] vmware.use_linked_clone = True {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.843848 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] vmware.vnc_keymap = en-us {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.844238 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] vmware.vnc_port = 5900 {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.844630 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] vmware.vnc_port_total = 10000 {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.845095 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] vnc.auth_schemes = ['none'] {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.845487 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] vnc.enabled = True {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.846118 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.846541 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] vnc.novncproxy_host = 0.0.0.0 {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.847014 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] vnc.novncproxy_port = 6080 {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.847455 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] vnc.server_listen = 127.0.0.1 {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.847765 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.848140 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] vnc.vencrypt_ca_certs = None {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.848514 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] vnc.vencrypt_client_cert = None {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.848888 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] vnc.vencrypt_client_key = None {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.849313 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] workarounds.disable_fallback_pcpu_query = False {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.849688 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] workarounds.disable_group_policy_check_upcall = False {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.850661 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.851045 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] workarounds.disable_native_luksv1 = False {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.851448 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] workarounds.disable_rootwrap = False {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.851830 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] workarounds.enable_numa_live_migration = False {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.852210 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.852592 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] workarounds.handle_virt_lifecycle_events = True {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.852976 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] workarounds.never_download_image_if_on_rbd = False {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.853363 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] workarounds.rbd_volume_local_attach = False {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.853745 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.854276 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.854620 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] wsgi.client_socket_timeout = 900 {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.855017 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] wsgi.default_pool_size = 1000 {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.855422 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] wsgi.keep_alive = True {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.855812 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] wsgi.max_header_line = 16384 {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.856191 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] wsgi.secure_proxy_ssl_header = None {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.856569 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] wsgi.ssl_ca_file = None {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.856947 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] wsgi.ssl_cert_file = None {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.857391 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] wsgi.ssl_key_file = None {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.857728 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] wsgi.tcp_keepidle = 600 {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.858136 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.858519 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] zvm.ca_file = None {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.858912 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] zvm.cloud_connector_url = None {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.859429 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.859827 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] zvm.reachable_timeout = 300 {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.860277 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] oslo_policy.enforce_new_defaults = False {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.860664 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] oslo_policy.enforce_scope = False {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.861082 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] oslo_policy.policy_default_rule = default {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.861592 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.861939 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] oslo_policy.policy_file = policy.yaml {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.862365 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.862746 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.863146 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.863521 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.863907 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.864393 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.864824 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] profiler.connection_string = messaging:// {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.865154 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] profiler.enabled = False {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.865566 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] profiler.es_doc_type = notification {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.866594 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] profiler.es_scroll_size = 10000 {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.866995 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] profiler.es_scroll_time = 2m {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.867399 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] profiler.filter_error_trace = False {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.867799 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] profiler.hmac_keys = SECRET_KEY {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.868209 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] profiler.sentinel_service_name = mymaster {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.868625 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] profiler.socket_timeout = 0.1 {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.869004 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] profiler.trace_sqlalchemy = False {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.869434 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] database.backend = sqlalchemy {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.869843 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] database.connection = **** {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.870229 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] database.connection_debug = 0 {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.870624 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] database.connection_parameters = {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.871021 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] database.connection_recycle_time = 3600 {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.871426 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] database.connection_trace = False {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.871811 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] database.db_inc_retry_interval = True {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.872186 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] database.db_max_retries = 20 {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.872563 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] database.db_max_retry_interval = 10 {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.872942 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] database.db_retry_interval = 1 {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.873327 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] database.max_overflow = 50 {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.873705 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] database.max_pool_size = 5 {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.874090 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] database.max_retries = 10 {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.874466 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] database.mysql_enable_ndb = False {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.874857 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.875258 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] database.pool_timeout = None {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.875720 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] database.retry_interval = 10 {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.876100 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] database.slave_connection = **** {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.876485 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] database.sqlite_synchronous = True {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.876864 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] database.use_db_reconnect = False {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.877245 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] database.use_tpool = False {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.877739 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] remote_debug.host = None {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.878074 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] remote_debug.port = None {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.878491 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.878877 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.879303 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.879692 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.880079 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.880462 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.880847 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.881415 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.881698 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.882082 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.882509 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.882893 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.883368 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.883760 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.884141 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.884558 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.884940 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.885326 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.885704 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.886186 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.886577 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.886976 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] oslo_messaging_rabbit.ssl = False {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.887399 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.887894 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.888219 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.888619 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] oslo_messaging_rabbit.ssl_version = {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.889070 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.889450 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] oslo_messaging_notifications.retry = -1 {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.889887 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.890281 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] oslo_messaging_notifications.transport_url = **** {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.890711 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] oslo_reports.file_event_handler = None {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.891135 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.891526 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] oslo_reports.log_dir = None {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 13:21:22.891884 n-d-791503-6 nova-conductor[97976]: DEBUG oslo_service.service [None req-0517be71-9c56-4500-854c-87e61abf24f2 None None] ******************************************************************************** {{(pid=97976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 28 13:24:22.760280 n-d-791503-6 nova-conductor[98844]: ERROR oslo.messaging._drivers.impl_rabbit [-] [8840711a-c4c2-4555-9645-ce157ee9cc0d] AMQP server on 10.222.0.68:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 28 13:24:22.776571 n-d-791503-6 nova-conductor[98843]: ERROR oslo.messaging._drivers.impl_rabbit [-] [eee199a3-5934-45a4-999a-298f0a81318b] AMQP server on 10.222.0.68:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 28 13:24:23.782337 n-d-791503-6 nova-conductor[98844]: INFO oslo.messaging._drivers.impl_rabbit [-] [8840711a-c4c2-4555-9645-ce157ee9cc0d] Reconnected to AMQP server on 10.222.0.68:5672 via [amqp] client with port 47190. May 28 13:24:23.796852 n-d-791503-6 nova-conductor[98843]: INFO oslo.messaging._drivers.impl_rabbit [-] [eee199a3-5934-45a4-999a-298f0a81318b] Reconnected to AMQP server on 10.222.0.68:5672 via [amqp] client with port 47192. May 28 13:27:23.778386 n-d-791503-6 nova-conductor[98844]: ERROR oslo.messaging._drivers.impl_rabbit [-] [8840711a-c4c2-4555-9645-ce157ee9cc0d] AMQP server on 10.222.0.68:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 28 13:27:23.793270 n-d-791503-6 nova-conductor[98843]: ERROR oslo.messaging._drivers.impl_rabbit [-] [eee199a3-5934-45a4-999a-298f0a81318b] AMQP server on 10.222.0.68:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 28 13:27:24.802237 n-d-791503-6 nova-conductor[98844]: INFO oslo.messaging._drivers.impl_rabbit [-] [8840711a-c4c2-4555-9645-ce157ee9cc0d] Reconnected to AMQP server on 10.222.0.68:5672 via [amqp] client with port 47256. May 28 13:27:24.815485 n-d-791503-6 nova-conductor[98843]: INFO oslo.messaging._drivers.impl_rabbit [-] [eee199a3-5934-45a4-999a-298f0a81318b] Reconnected to AMQP server on 10.222.0.68:5672 via [amqp] client with port 47258. May 28 13:30:24.799768 n-d-791503-6 nova-conductor[98844]: ERROR oslo.messaging._drivers.impl_rabbit [-] [8840711a-c4c2-4555-9645-ce157ee9cc0d] AMQP server on 10.222.0.68:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 28 13:30:24.812087 n-d-791503-6 nova-conductor[98843]: ERROR oslo.messaging._drivers.impl_rabbit [-] [eee199a3-5934-45a4-999a-298f0a81318b] AMQP server on 10.222.0.68:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 28 13:30:25.873704 n-d-791503-6 nova-conductor[98844]: INFO oslo.messaging._drivers.impl_rabbit [-] [8840711a-c4c2-4555-9645-ce157ee9cc0d] Reconnected to AMQP server on 10.222.0.68:5672 via [amqp] client with port 47380. May 28 13:30:25.908789 n-d-791503-6 nova-conductor[98843]: INFO oslo.messaging._drivers.impl_rabbit [-] [eee199a3-5934-45a4-999a-298f0a81318b] Reconnected to AMQP server on 10.222.0.68:5672 via [amqp] client with port 47378. May 28 13:30:44.967338 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_db.sqlalchemy.engines [None req-5904bc07-cb4f-42b3-b1a8-426b0bedaaec tempest-DeleteServersAdminTestJSON-1616408685 tempest-DeleteServersAdminTestJSON-1616408685-project] Parent process 97976 forked (98844) with an open database connection, which is being discarded and recreated. {{(pid=98844) checkout /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:413}} May 28 13:30:46.245932 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_db.sqlalchemy.engines [None req-5670ed38-4a8e-41e4-a7bf-31e3cdd3070d tempest-AggregatesAdminTestJSON-1996239209 tempest-AggregatesAdminTestJSON-1996239209-project] Parent process 97976 forked (98843) with an open database connection, which is being discarded and recreated. {{(pid=98843) checkout /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:413}} May 28 13:30:46.798763 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.manager [None req-5904bc07-cb4f-42b3-b1a8-426b0bedaaec tempest-DeleteServersAdminTestJSON-1616408685 tempest-DeleteServersAdminTestJSON-1616408685-project] Took 1.81 seconds to select destinations for 1 instance(s). {{(pid=98844) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 13:30:46.899559 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-5904bc07-cb4f-42b3-b1a8-426b0bedaaec tempest-DeleteServersAdminTestJSON-1616408685 tempest-DeleteServersAdminTestJSON-1616408685-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:30:46.919270 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-5904bc07-cb4f-42b3-b1a8-426b0bedaaec tempest-DeleteServersAdminTestJSON-1616408685 tempest-DeleteServersAdminTestJSON-1616408685-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:30:46.954496 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_db.sqlalchemy.engines [None req-5904bc07-cb4f-42b3-b1a8-426b0bedaaec tempest-DeleteServersAdminTestJSON-1616408685 tempest-DeleteServersAdminTestJSON-1616408685-project] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=98844) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 28 13:30:47.288824 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-5904bc07-cb4f-42b3-b1a8-426b0bedaaec tempest-DeleteServersAdminTestJSON-1616408685 tempest-DeleteServersAdminTestJSON-1616408685-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:30:47.290588 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-5904bc07-cb4f-42b3-b1a8-426b0bedaaec tempest-DeleteServersAdminTestJSON-1616408685 tempest-DeleteServersAdminTestJSON-1616408685-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:30:47.291965 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-5904bc07-cb4f-42b3-b1a8-426b0bedaaec tempest-DeleteServersAdminTestJSON-1616408685 tempest-DeleteServersAdminTestJSON-1616408685-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:30:47.292360 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-5904bc07-cb4f-42b3-b1a8-426b0bedaaec tempest-DeleteServersAdminTestJSON-1616408685 tempest-DeleteServersAdminTestJSON-1616408685-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:30:47.341348 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_db.sqlalchemy.engines [None req-5904bc07-cb4f-42b3-b1a8-426b0bedaaec tempest-DeleteServersAdminTestJSON-1616408685 tempest-DeleteServersAdminTestJSON-1616408685-project] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=98844) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 28 13:30:47.364351 n-d-791503-6 nova-conductor[98844]: DEBUG nova.quota [None req-5904bc07-cb4f-42b3-b1a8-426b0bedaaec tempest-DeleteServersAdminTestJSON-1616408685 tempest-DeleteServersAdminTestJSON-1616408685-project] Getting quotas for project 320555daf3fd4e75923646beb266aebe. Resources: {'cores', 'ram', 'instances'} {{(pid=98844) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 13:30:47.370969 n-d-791503-6 nova-conductor[98844]: DEBUG nova.quota [None req-5904bc07-cb4f-42b3-b1a8-426b0bedaaec tempest-DeleteServersAdminTestJSON-1616408685 tempest-DeleteServersAdminTestJSON-1616408685-project] Getting quotas for user 107bda86185a44a1bf5c279274fcc930 and project 320555daf3fd4e75923646beb266aebe. Resources: {'cores', 'ram', 'instances'} {{(pid=98844) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 13:30:47.383232 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.manager [None req-5904bc07-cb4f-42b3-b1a8-426b0bedaaec tempest-DeleteServersAdminTestJSON-1616408685 tempest-DeleteServersAdminTestJSON-1616408685-project] [instance: 5c723533-a067-49fb-ba30-5cdabfbad2c6] Selected host: n-h1-791503-6; Selected node: n-h1-791503-6; Alternates: [('n-h2-791503-6', 'n-h2-791503-6')] {{(pid=98844) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 13:30:47.385039 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-5904bc07-cb4f-42b3-b1a8-426b0bedaaec tempest-DeleteServersAdminTestJSON-1616408685 tempest-DeleteServersAdminTestJSON-1616408685-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:30:47.385612 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-5904bc07-cb4f-42b3-b1a8-426b0bedaaec tempest-DeleteServersAdminTestJSON-1616408685 tempest-DeleteServersAdminTestJSON-1616408685-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:30:47.397844 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.manager [None req-5904bc07-cb4f-42b3-b1a8-426b0bedaaec tempest-DeleteServersAdminTestJSON-1616408685 tempest-DeleteServersAdminTestJSON-1616408685-project] [instance: 5c723533-a067-49fb-ba30-5cdabfbad2c6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='64f6036b-99a9-40e4-8963-3cdf66964954',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98844) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 13:30:47.402957 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-5904bc07-cb4f-42b3-b1a8-426b0bedaaec tempest-DeleteServersAdminTestJSON-1616408685 tempest-DeleteServersAdminTestJSON-1616408685-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:30:47.403806 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-5904bc07-cb4f-42b3-b1a8-426b0bedaaec tempest-DeleteServersAdminTestJSON-1616408685 tempest-DeleteServersAdminTestJSON-1616408685-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:30:47.489905 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-5904bc07-cb4f-42b3-b1a8-426b0bedaaec tempest-DeleteServersAdminTestJSON-1616408685 tempest-DeleteServersAdminTestJSON-1616408685-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:30:47.490669 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-5904bc07-cb4f-42b3-b1a8-426b0bedaaec tempest-DeleteServersAdminTestJSON-1616408685 tempest-DeleteServersAdminTestJSON-1616408685-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:30:47.496733 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-5904bc07-cb4f-42b3-b1a8-426b0bedaaec tempest-DeleteServersAdminTestJSON-1616408685 tempest-DeleteServersAdminTestJSON-1616408685-project] Acquired lock "compute-rpcapi-router" {{(pid=98844) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:266}} May 28 13:30:47.508475 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-a19a238d-96a2-4df2-b257-f934ca3d89b4 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:30:47.515716 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-a19a238d-96a2-4df2-b257-f934ca3d89b4 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:30:47.522680 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-a19a238d-96a2-4df2-b257-f934ca3d89b4 None None] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:30:47.532892 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-a19a238d-96a2-4df2-b257-f934ca3d89b4 None None] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:30:47.616163 n-d-791503-6 nova-conductor[98844]: INFO nova.compute.rpcapi [None req-a19a238d-96a2-4df2-b257-f934ca3d89b4 None None] Automatically selected compute RPC version 6.0 from minimum service version 56 May 28 13:30:47.617103 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-a19a238d-96a2-4df2-b257-f934ca3d89b4 None None] Releasing lock "compute-rpcapi-router" {{(pid=98844) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:282}} May 28 13:30:47.804020 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-5670ed38-4a8e-41e4-a7bf-31e3cdd3070d tempest-AggregatesAdminTestJSON-1996239209 tempest-AggregatesAdminTestJSON-1996239209-project] Took 1.51 seconds to select destinations for 1 instance(s). {{(pid=98843) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 13:30:47.925848 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-5670ed38-4a8e-41e4-a7bf-31e3cdd3070d tempest-AggregatesAdminTestJSON-1996239209 tempest-AggregatesAdminTestJSON-1996239209-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:30:47.932986 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-5670ed38-4a8e-41e4-a7bf-31e3cdd3070d tempest-AggregatesAdminTestJSON-1996239209 tempest-AggregatesAdminTestJSON-1996239209-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:30:47.970175 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_db.sqlalchemy.engines [None req-5670ed38-4a8e-41e4-a7bf-31e3cdd3070d tempest-AggregatesAdminTestJSON-1996239209 tempest-AggregatesAdminTestJSON-1996239209-project] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=98843) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 28 13:30:48.379155 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-5670ed38-4a8e-41e4-a7bf-31e3cdd3070d tempest-AggregatesAdminTestJSON-1996239209 tempest-AggregatesAdminTestJSON-1996239209-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:30:48.384021 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-5670ed38-4a8e-41e4-a7bf-31e3cdd3070d tempest-AggregatesAdminTestJSON-1996239209 tempest-AggregatesAdminTestJSON-1996239209-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:30:48.385952 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-5670ed38-4a8e-41e4-a7bf-31e3cdd3070d tempest-AggregatesAdminTestJSON-1996239209 tempest-AggregatesAdminTestJSON-1996239209-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:30:48.388241 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-5670ed38-4a8e-41e4-a7bf-31e3cdd3070d tempest-AggregatesAdminTestJSON-1996239209 tempest-AggregatesAdminTestJSON-1996239209-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:30:48.461320 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_db.sqlalchemy.engines [None req-5670ed38-4a8e-41e4-a7bf-31e3cdd3070d tempest-AggregatesAdminTestJSON-1996239209 tempest-AggregatesAdminTestJSON-1996239209-project] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=98843) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 28 13:30:48.520862 n-d-791503-6 nova-conductor[98843]: DEBUG nova.quota [None req-5670ed38-4a8e-41e4-a7bf-31e3cdd3070d tempest-AggregatesAdminTestJSON-1996239209 tempest-AggregatesAdminTestJSON-1996239209-project] Getting quotas for project 62ffb2cf826d4f688d4fe40cf588dc4e. Resources: {'cores', 'ram', 'instances'} {{(pid=98843) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 13:30:48.554300 n-d-791503-6 nova-conductor[98843]: DEBUG nova.quota [None req-5670ed38-4a8e-41e4-a7bf-31e3cdd3070d tempest-AggregatesAdminTestJSON-1996239209 tempest-AggregatesAdminTestJSON-1996239209-project] Getting quotas for user 6886cc1056e94c1d9d6ddb37f29f86c4 and project 62ffb2cf826d4f688d4fe40cf588dc4e. Resources: {'cores', 'ram', 'instances'} {{(pid=98843) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 13:30:48.736806 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-5670ed38-4a8e-41e4-a7bf-31e3cdd3070d tempest-AggregatesAdminTestJSON-1996239209 tempest-AggregatesAdminTestJSON-1996239209-project] [instance: c94ea4a0-9dff-4819-9ca8-73ca87943d0d] Selected host: n-h2-791503-6; Selected node: n-h2-791503-6; Alternates: [] {{(pid=98843) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 13:30:48.749237 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-5670ed38-4a8e-41e4-a7bf-31e3cdd3070d tempest-AggregatesAdminTestJSON-1996239209 tempest-AggregatesAdminTestJSON-1996239209-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:30:48.749870 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-5670ed38-4a8e-41e4-a7bf-31e3cdd3070d tempest-AggregatesAdminTestJSON-1996239209 tempest-AggregatesAdminTestJSON-1996239209-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:30:48.806256 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-5670ed38-4a8e-41e4-a7bf-31e3cdd3070d tempest-AggregatesAdminTestJSON-1996239209 tempest-AggregatesAdminTestJSON-1996239209-project] [instance: c94ea4a0-9dff-4819-9ca8-73ca87943d0d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='64f6036b-99a9-40e4-8963-3cdf66964954',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98843) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 13:30:48.823647 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-5670ed38-4a8e-41e4-a7bf-31e3cdd3070d tempest-AggregatesAdminTestJSON-1996239209 tempest-AggregatesAdminTestJSON-1996239209-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:30:48.826487 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-5670ed38-4a8e-41e4-a7bf-31e3cdd3070d tempest-AggregatesAdminTestJSON-1996239209 tempest-AggregatesAdminTestJSON-1996239209-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:30:49.012128 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-5670ed38-4a8e-41e4-a7bf-31e3cdd3070d tempest-AggregatesAdminTestJSON-1996239209 tempest-AggregatesAdminTestJSON-1996239209-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:30:49.013516 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-5670ed38-4a8e-41e4-a7bf-31e3cdd3070d tempest-AggregatesAdminTestJSON-1996239209 tempest-AggregatesAdminTestJSON-1996239209-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:30:49.018069 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-5670ed38-4a8e-41e4-a7bf-31e3cdd3070d tempest-AggregatesAdminTestJSON-1996239209 tempest-AggregatesAdminTestJSON-1996239209-project] Acquired lock "compute-rpcapi-router" {{(pid=98843) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:266}} May 28 13:30:49.025576 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-59e29a85-15aa-4f88-80e0-a004a24639a0 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:30:49.026221 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-59e29a85-15aa-4f88-80e0-a004a24639a0 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:30:49.027016 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-59e29a85-15aa-4f88-80e0-a004a24639a0 None None] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:30:49.027551 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-59e29a85-15aa-4f88-80e0-a004a24639a0 None None] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:30:49.079862 n-d-791503-6 nova-conductor[98843]: INFO nova.compute.rpcapi [None req-59e29a85-15aa-4f88-80e0-a004a24639a0 None None] Automatically selected compute RPC version 6.0 from minimum service version 56 May 28 13:30:49.086882 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-59e29a85-15aa-4f88-80e0-a004a24639a0 None None] Releasing lock "compute-rpcapi-router" {{(pid=98843) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:282}} May 28 13:31:33.333497 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.manager [None req-2dcfa335-4975-4541-b668-037e4ba08ae8 tempest-ServersWithSpecificFlavorTestJSON-1001305181 tempest-ServersWithSpecificFlavorTestJSON-1001305181-project] Took 0.51 seconds to select destinations for 1 instance(s). {{(pid=98844) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 13:31:33.386889 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-2dcfa335-4975-4541-b668-037e4ba08ae8 tempest-ServersWithSpecificFlavorTestJSON-1001305181 tempest-ServersWithSpecificFlavorTestJSON-1001305181-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:31:33.387971 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-2dcfa335-4975-4541-b668-037e4ba08ae8 tempest-ServersWithSpecificFlavorTestJSON-1001305181 tempest-ServersWithSpecificFlavorTestJSON-1001305181-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:31:33.510097 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-2dcfa335-4975-4541-b668-037e4ba08ae8 tempest-ServersWithSpecificFlavorTestJSON-1001305181 tempest-ServersWithSpecificFlavorTestJSON-1001305181-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:31:33.511467 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-2dcfa335-4975-4541-b668-037e4ba08ae8 tempest-ServersWithSpecificFlavorTestJSON-1001305181 tempest-ServersWithSpecificFlavorTestJSON-1001305181-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:31:33.513242 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-2dcfa335-4975-4541-b668-037e4ba08ae8 tempest-ServersWithSpecificFlavorTestJSON-1001305181 tempest-ServersWithSpecificFlavorTestJSON-1001305181-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:31:33.513991 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-2dcfa335-4975-4541-b668-037e4ba08ae8 tempest-ServersWithSpecificFlavorTestJSON-1001305181 tempest-ServersWithSpecificFlavorTestJSON-1001305181-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:31:33.550910 n-d-791503-6 nova-conductor[98844]: DEBUG nova.quota [None req-2dcfa335-4975-4541-b668-037e4ba08ae8 tempest-ServersWithSpecificFlavorTestJSON-1001305181 tempest-ServersWithSpecificFlavorTestJSON-1001305181-project] Getting quotas for project 1a63ef5eb4bc415c8d016fa4f214ba55. Resources: {'cores', 'ram', 'instances'} {{(pid=98844) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 13:31:33.558982 n-d-791503-6 nova-conductor[98844]: DEBUG nova.quota [None req-2dcfa335-4975-4541-b668-037e4ba08ae8 tempest-ServersWithSpecificFlavorTestJSON-1001305181 tempest-ServersWithSpecificFlavorTestJSON-1001305181-project] Getting quotas for user f46f4d9926b349459955bf63a7c3f857 and project 1a63ef5eb4bc415c8d016fa4f214ba55. Resources: {'cores', 'ram', 'instances'} {{(pid=98844) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 13:31:33.582724 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.manager [None req-2dcfa335-4975-4541-b668-037e4ba08ae8 tempest-ServersWithSpecificFlavorTestJSON-1001305181 tempest-ServersWithSpecificFlavorTestJSON-1001305181-project] [instance: 34722b2b-9ceb-4eb9-b49f-ac1a67064134] Selected host: n-h1-791503-6; Selected node: n-h1-791503-6; Alternates: [('n-h2-791503-6', 'n-h2-791503-6')] {{(pid=98844) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 13:31:33.584821 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-2dcfa335-4975-4541-b668-037e4ba08ae8 tempest-ServersWithSpecificFlavorTestJSON-1001305181 tempest-ServersWithSpecificFlavorTestJSON-1001305181-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:31:33.585766 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-2dcfa335-4975-4541-b668-037e4ba08ae8 tempest-ServersWithSpecificFlavorTestJSON-1001305181 tempest-ServersWithSpecificFlavorTestJSON-1001305181-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:31:33.602577 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.manager [None req-2dcfa335-4975-4541-b668-037e4ba08ae8 tempest-ServersWithSpecificFlavorTestJSON-1001305181 tempest-ServersWithSpecificFlavorTestJSON-1001305181-project] [instance: 34722b2b-9ceb-4eb9-b49f-ac1a67064134] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='64f6036b-99a9-40e4-8963-3cdf66964954',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98844) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 13:31:33.606482 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-2dcfa335-4975-4541-b668-037e4ba08ae8 tempest-ServersWithSpecificFlavorTestJSON-1001305181 tempest-ServersWithSpecificFlavorTestJSON-1001305181-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:31:33.608355 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-2dcfa335-4975-4541-b668-037e4ba08ae8 tempest-ServersWithSpecificFlavorTestJSON-1001305181 tempest-ServersWithSpecificFlavorTestJSON-1001305181-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:31:33.678163 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-2dcfa335-4975-4541-b668-037e4ba08ae8 tempest-ServersWithSpecificFlavorTestJSON-1001305181 tempest-ServersWithSpecificFlavorTestJSON-1001305181-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:31:33.679664 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-2dcfa335-4975-4541-b668-037e4ba08ae8 tempest-ServersWithSpecificFlavorTestJSON-1001305181 tempest-ServersWithSpecificFlavorTestJSON-1001305181-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:31:48.478673 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-dcd1a0d4-110e-4867-8ce5-afd679b0f922 tempest-DeleteServersAdminTestJSON-1616408685 tempest-DeleteServersAdminTestJSON-1616408685-project] Took 0.76 seconds to select destinations for 1 instance(s). {{(pid=98843) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 13:31:48.545272 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-dcd1a0d4-110e-4867-8ce5-afd679b0f922 tempest-DeleteServersAdminTestJSON-1616408685 tempest-DeleteServersAdminTestJSON-1616408685-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:31:48.546156 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-dcd1a0d4-110e-4867-8ce5-afd679b0f922 tempest-DeleteServersAdminTestJSON-1616408685 tempest-DeleteServersAdminTestJSON-1616408685-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:31:48.751716 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-dcd1a0d4-110e-4867-8ce5-afd679b0f922 tempest-DeleteServersAdminTestJSON-1616408685 tempest-DeleteServersAdminTestJSON-1616408685-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:31:48.752468 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-dcd1a0d4-110e-4867-8ce5-afd679b0f922 tempest-DeleteServersAdminTestJSON-1616408685 tempest-DeleteServersAdminTestJSON-1616408685-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:31:48.753428 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-dcd1a0d4-110e-4867-8ce5-afd679b0f922 tempest-DeleteServersAdminTestJSON-1616408685 tempest-DeleteServersAdminTestJSON-1616408685-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:31:48.757023 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-dcd1a0d4-110e-4867-8ce5-afd679b0f922 tempest-DeleteServersAdminTestJSON-1616408685 tempest-DeleteServersAdminTestJSON-1616408685-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:31:48.859193 n-d-791503-6 nova-conductor[98843]: DEBUG nova.quota [None req-dcd1a0d4-110e-4867-8ce5-afd679b0f922 tempest-DeleteServersAdminTestJSON-1616408685 tempest-DeleteServersAdminTestJSON-1616408685-project] Getting quotas for project 320555daf3fd4e75923646beb266aebe. Resources: {'cores', 'ram', 'instances'} {{(pid=98843) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 13:31:48.880196 n-d-791503-6 nova-conductor[98843]: DEBUG nova.quota [None req-dcd1a0d4-110e-4867-8ce5-afd679b0f922 tempest-DeleteServersAdminTestJSON-1616408685 tempest-DeleteServersAdminTestJSON-1616408685-project] Getting quotas for user 107bda86185a44a1bf5c279274fcc930 and project 320555daf3fd4e75923646beb266aebe. Resources: {'cores', 'ram', 'instances'} {{(pid=98843) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 13:31:48.913333 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-dcd1a0d4-110e-4867-8ce5-afd679b0f922 tempest-DeleteServersAdminTestJSON-1616408685 tempest-DeleteServersAdminTestJSON-1616408685-project] [instance: 0d2efcf5-4763-484c-b63b-8377a5a93327] Selected host: n-h1-791503-6; Selected node: n-h1-791503-6; Alternates: [('n-h2-791503-6', 'n-h2-791503-6')] {{(pid=98843) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 13:31:48.913333 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-dcd1a0d4-110e-4867-8ce5-afd679b0f922 tempest-DeleteServersAdminTestJSON-1616408685 tempest-DeleteServersAdminTestJSON-1616408685-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:31:48.915276 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-dcd1a0d4-110e-4867-8ce5-afd679b0f922 tempest-DeleteServersAdminTestJSON-1616408685 tempest-DeleteServersAdminTestJSON-1616408685-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:31:48.932656 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-dcd1a0d4-110e-4867-8ce5-afd679b0f922 tempest-DeleteServersAdminTestJSON-1616408685 tempest-DeleteServersAdminTestJSON-1616408685-project] [instance: 0d2efcf5-4763-484c-b63b-8377a5a93327] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='64f6036b-99a9-40e4-8963-3cdf66964954',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98843) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 13:31:48.934574 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-dcd1a0d4-110e-4867-8ce5-afd679b0f922 tempest-DeleteServersAdminTestJSON-1616408685 tempest-DeleteServersAdminTestJSON-1616408685-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:31:48.935328 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-dcd1a0d4-110e-4867-8ce5-afd679b0f922 tempest-DeleteServersAdminTestJSON-1616408685 tempest-DeleteServersAdminTestJSON-1616408685-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:31:49.031183 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-dcd1a0d4-110e-4867-8ce5-afd679b0f922 tempest-DeleteServersAdminTestJSON-1616408685 tempest-DeleteServersAdminTestJSON-1616408685-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:31:49.032202 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-dcd1a0d4-110e-4867-8ce5-afd679b0f922 tempest-DeleteServersAdminTestJSON-1616408685 tempest-DeleteServersAdminTestJSON-1616408685-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:31:55.158295 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.manager [None req-3c7b1446-6fcf-47f7-b9c8-fd885df96739 tempest-LiveMigrationNegativeTest-1073271810 tempest-LiveMigrationNegativeTest-1073271810-project] Took 0.80 seconds to select destinations for 1 instance(s). {{(pid=98844) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 13:31:55.226072 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-3c7b1446-6fcf-47f7-b9c8-fd885df96739 tempest-LiveMigrationNegativeTest-1073271810 tempest-LiveMigrationNegativeTest-1073271810-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:31:55.227049 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-3c7b1446-6fcf-47f7-b9c8-fd885df96739 tempest-LiveMigrationNegativeTest-1073271810 tempest-LiveMigrationNegativeTest-1073271810-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:31:55.367800 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-3c7b1446-6fcf-47f7-b9c8-fd885df96739 tempest-LiveMigrationNegativeTest-1073271810 tempest-LiveMigrationNegativeTest-1073271810-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:31:55.369084 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-3c7b1446-6fcf-47f7-b9c8-fd885df96739 tempest-LiveMigrationNegativeTest-1073271810 tempest-LiveMigrationNegativeTest-1073271810-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:31:55.371037 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-3c7b1446-6fcf-47f7-b9c8-fd885df96739 tempest-LiveMigrationNegativeTest-1073271810 tempest-LiveMigrationNegativeTest-1073271810-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:31:55.371400 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-3c7b1446-6fcf-47f7-b9c8-fd885df96739 tempest-LiveMigrationNegativeTest-1073271810 tempest-LiveMigrationNegativeTest-1073271810-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:31:55.430122 n-d-791503-6 nova-conductor[98844]: DEBUG nova.quota [None req-3c7b1446-6fcf-47f7-b9c8-fd885df96739 tempest-LiveMigrationNegativeTest-1073271810 tempest-LiveMigrationNegativeTest-1073271810-project] Getting quotas for project 9ff0c754879d465cb53258c6273b353b. Resources: {'cores', 'ram', 'instances'} {{(pid=98844) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 13:31:55.440855 n-d-791503-6 nova-conductor[98844]: DEBUG nova.quota [None req-3c7b1446-6fcf-47f7-b9c8-fd885df96739 tempest-LiveMigrationNegativeTest-1073271810 tempest-LiveMigrationNegativeTest-1073271810-project] Getting quotas for user edcb72dbdecf44629734f5c6167bd605 and project 9ff0c754879d465cb53258c6273b353b. Resources: {'cores', 'ram', 'instances'} {{(pid=98844) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 13:31:55.472934 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.manager [None req-3c7b1446-6fcf-47f7-b9c8-fd885df96739 tempest-LiveMigrationNegativeTest-1073271810 tempest-LiveMigrationNegativeTest-1073271810-project] [instance: 092c9f93-364a-4c65-9c6c-ce67b7c33038] Selected host: n-h2-791503-6; Selected node: n-h2-791503-6; Alternates: [('n-h1-791503-6', 'n-h1-791503-6')] {{(pid=98844) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 13:31:55.476675 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-3c7b1446-6fcf-47f7-b9c8-fd885df96739 tempest-LiveMigrationNegativeTest-1073271810 tempest-LiveMigrationNegativeTest-1073271810-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:31:55.477463 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-3c7b1446-6fcf-47f7-b9c8-fd885df96739 tempest-LiveMigrationNegativeTest-1073271810 tempest-LiveMigrationNegativeTest-1073271810-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:31:55.491327 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.manager [None req-3c7b1446-6fcf-47f7-b9c8-fd885df96739 tempest-LiveMigrationNegativeTest-1073271810 tempest-LiveMigrationNegativeTest-1073271810-project] [instance: 092c9f93-364a-4c65-9c6c-ce67b7c33038] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='64f6036b-99a9-40e4-8963-3cdf66964954',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98844) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 13:31:55.494046 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-3c7b1446-6fcf-47f7-b9c8-fd885df96739 tempest-LiveMigrationNegativeTest-1073271810 tempest-LiveMigrationNegativeTest-1073271810-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:31:55.494875 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-3c7b1446-6fcf-47f7-b9c8-fd885df96739 tempest-LiveMigrationNegativeTest-1073271810 tempest-LiveMigrationNegativeTest-1073271810-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:31:55.569310 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-3c7b1446-6fcf-47f7-b9c8-fd885df96739 tempest-LiveMigrationNegativeTest-1073271810 tempest-LiveMigrationNegativeTest-1073271810-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:31:55.570100 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-3c7b1446-6fcf-47f7-b9c8-fd885df96739 tempest-LiveMigrationNegativeTest-1073271810 tempest-LiveMigrationNegativeTest-1073271810-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:31:59.020504 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-1e3d0e6b-7eb6-47fb-a208-7659c7c868c4 tempest-LiveAutoBlockMigrationV225Test-1477466171 tempest-LiveAutoBlockMigrationV225Test-1477466171-project] Took 0.62 seconds to select destinations for 1 instance(s). {{(pid=98843) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 13:31:59.072647 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-1e3d0e6b-7eb6-47fb-a208-7659c7c868c4 tempest-LiveAutoBlockMigrationV225Test-1477466171 tempest-LiveAutoBlockMigrationV225Test-1477466171-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:31:59.073051 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-1e3d0e6b-7eb6-47fb-a208-7659c7c868c4 tempest-LiveAutoBlockMigrationV225Test-1477466171 tempest-LiveAutoBlockMigrationV225Test-1477466171-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:31:59.188077 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-1e3d0e6b-7eb6-47fb-a208-7659c7c868c4 tempest-LiveAutoBlockMigrationV225Test-1477466171 tempest-LiveAutoBlockMigrationV225Test-1477466171-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:31:59.188728 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-1e3d0e6b-7eb6-47fb-a208-7659c7c868c4 tempest-LiveAutoBlockMigrationV225Test-1477466171 tempest-LiveAutoBlockMigrationV225Test-1477466171-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:31:59.194731 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-1e3d0e6b-7eb6-47fb-a208-7659c7c868c4 tempest-LiveAutoBlockMigrationV225Test-1477466171 tempest-LiveAutoBlockMigrationV225Test-1477466171-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:31:59.196644 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-1e3d0e6b-7eb6-47fb-a208-7659c7c868c4 tempest-LiveAutoBlockMigrationV225Test-1477466171 tempest-LiveAutoBlockMigrationV225Test-1477466171-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:31:59.265955 n-d-791503-6 nova-conductor[98843]: DEBUG nova.quota [None req-1e3d0e6b-7eb6-47fb-a208-7659c7c868c4 tempest-LiveAutoBlockMigrationV225Test-1477466171 tempest-LiveAutoBlockMigrationV225Test-1477466171-project] Getting quotas for project 7196124f74dc4f2182b1810bc09cdad0. Resources: {'cores', 'ram', 'instances'} {{(pid=98843) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 13:31:59.274852 n-d-791503-6 nova-conductor[98843]: DEBUG nova.quota [None req-1e3d0e6b-7eb6-47fb-a208-7659c7c868c4 tempest-LiveAutoBlockMigrationV225Test-1477466171 tempest-LiveAutoBlockMigrationV225Test-1477466171-project] Getting quotas for user d6f8e0f353fb4d25b3345c954b120a5e and project 7196124f74dc4f2182b1810bc09cdad0. Resources: {'cores', 'ram', 'instances'} {{(pid=98843) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 13:31:59.315975 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-1e3d0e6b-7eb6-47fb-a208-7659c7c868c4 tempest-LiveAutoBlockMigrationV225Test-1477466171 tempest-LiveAutoBlockMigrationV225Test-1477466171-project] [instance: ba866e87-c9ad-4ef0-8991-088dc9fab3ec] Selected host: n-h2-791503-6; Selected node: n-h2-791503-6; Alternates: [('n-h1-791503-6', 'n-h1-791503-6')] {{(pid=98843) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 13:31:59.317961 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-1e3d0e6b-7eb6-47fb-a208-7659c7c868c4 tempest-LiveAutoBlockMigrationV225Test-1477466171 tempest-LiveAutoBlockMigrationV225Test-1477466171-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:31:59.318608 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-1e3d0e6b-7eb6-47fb-a208-7659c7c868c4 tempest-LiveAutoBlockMigrationV225Test-1477466171 tempest-LiveAutoBlockMigrationV225Test-1477466171-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:31:59.343895 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-1e3d0e6b-7eb6-47fb-a208-7659c7c868c4 tempest-LiveAutoBlockMigrationV225Test-1477466171 tempest-LiveAutoBlockMigrationV225Test-1477466171-project] [instance: ba866e87-c9ad-4ef0-8991-088dc9fab3ec] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='64f6036b-99a9-40e4-8963-3cdf66964954',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98843) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 13:31:59.346291 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-1e3d0e6b-7eb6-47fb-a208-7659c7c868c4 tempest-LiveAutoBlockMigrationV225Test-1477466171 tempest-LiveAutoBlockMigrationV225Test-1477466171-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:31:59.347229 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-1e3d0e6b-7eb6-47fb-a208-7659c7c868c4 tempest-LiveAutoBlockMigrationV225Test-1477466171 tempest-LiveAutoBlockMigrationV225Test-1477466171-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:31:59.460321 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-1e3d0e6b-7eb6-47fb-a208-7659c7c868c4 tempest-LiveAutoBlockMigrationV225Test-1477466171 tempest-LiveAutoBlockMigrationV225Test-1477466171-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:31:59.460321 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-1e3d0e6b-7eb6-47fb-a208-7659c7c868c4 tempest-LiveAutoBlockMigrationV225Test-1477466171 tempest-LiveAutoBlockMigrationV225Test-1477466171-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:32:23.162265 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.manager [None req-107daf06-9caf-43eb-b9bb-95cc55900823 tempest-LiveAutoBlockMigrationV225Test-1459235087 tempest-LiveAutoBlockMigrationV225Test-1459235087-project-admin] Targeting cell b241212c-c279-4fbb-a1e7-b87889287cbf(cell1) for conductor method migrate_server {{(pid=98844) wrapper /opt/stack/nova/nova/conductor/manager.py:91}} May 28 13:32:23.163494 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-107daf06-9caf-43eb-b9bb-95cc55900823 tempest-LiveAutoBlockMigrationV225Test-1459235087 tempest-LiveAutoBlockMigrationV225Test-1459235087-project-admin] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:32:23.164317 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-107daf06-9caf-43eb-b9bb-95cc55900823 tempest-LiveAutoBlockMigrationV225Test-1459235087 tempest-LiveAutoBlockMigrationV225Test-1459235087-project-admin] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:32:24.421915 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.tasks.migrate [None req-107daf06-9caf-43eb-b9bb-95cc55900823 tempest-LiveAutoBlockMigrationV225Test-1459235087 tempest-LiveAutoBlockMigrationV225Test-1459235087-project-admin] Created allocations for migration 87acdb01-ee9d-4bf4-a478-bc637491364c on 5c5ac110-743a-4b71-a058-d2597ba8e0c9 {{(pid=98844) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} May 28 13:32:25.119835 n-d-791503-6 nova-conductor[98844]: DEBUG nova.scheduler.utils [None req-107daf06-9caf-43eb-b9bb-95cc55900823 tempest-LiveAutoBlockMigrationV225Test-1459235087 tempest-LiveAutoBlockMigrationV225Test-1459235087-project-admin] [instance: ba866e87-c9ad-4ef0-8991-088dc9fab3ec] Instance allocations successfully created on destination node d4341c2e-3ff0-43f5-9b7e-4ec6191a47d4: {'allocations': {'d4341c2e-3ff0-43f5-9b7e-4ec6191a47d4': {'resources': {'VCPU': 1, 'MEMORY_MB': 1024, 'DISK_GB': 1}}}} {{(pid=98844) claim_resources_on_destination /opt/stack/nova/nova/scheduler/utils.py:827}} May 28 13:32:25.120376 n-d-791503-6 nova-conductor[98844]: DEBUG nova.objects.instance [None req-107daf06-9caf-43eb-b9bb-95cc55900823 tempest-LiveAutoBlockMigrationV225Test-1459235087 tempest-LiveAutoBlockMigrationV225Test-1459235087-project-admin] Lazy-loading 'resources' on Instance uuid ba866e87-c9ad-4ef0-8991-088dc9fab3ec {{(pid=98844) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 28 13:32:25.132132 n-d-791503-6 nova-conductor[98844]: DEBUG nova.objects.instance [None req-107daf06-9caf-43eb-b9bb-95cc55900823 tempest-LiveAutoBlockMigrationV225Test-1459235087 tempest-LiveAutoBlockMigrationV225Test-1459235087-project-admin] Lazy-loading 'pci_requests' on Instance uuid ba866e87-c9ad-4ef0-8991-088dc9fab3ec {{(pid=98844) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 28 13:32:26.652639 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.tasks.live_migrate [None req-107daf06-9caf-43eb-b9bb-95cc55900823 tempest-LiveAutoBlockMigrationV225Test-1459235087 tempest-LiveAutoBlockMigrationV225Test-1459235087-project-admin] [instance: ba866e87-c9ad-4ef0-8991-088dc9fab3ec] Start binding ports on destination host: n-h1-791503-6 {{(pid=98844) _bind_ports_on_destination /opt/stack/nova/nova/conductor/tasks/live_migrate.py:389}} May 28 13:32:29.455850 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-6c545222-0280-4fcf-899f-86e8a1c7f877 tempest-LiveMigrationNegativeTest-1073271810 tempest-LiveMigrationNegativeTest-1073271810-project] Took 0.58 seconds to select destinations for 1 instance(s). {{(pid=98843) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 13:32:29.528425 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-6c545222-0280-4fcf-899f-86e8a1c7f877 tempest-LiveMigrationNegativeTest-1073271810 tempest-LiveMigrationNegativeTest-1073271810-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:32:29.529187 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-6c545222-0280-4fcf-899f-86e8a1c7f877 tempest-LiveMigrationNegativeTest-1073271810 tempest-LiveMigrationNegativeTest-1073271810-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:32:29.636360 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-6c545222-0280-4fcf-899f-86e8a1c7f877 tempest-LiveMigrationNegativeTest-1073271810 tempest-LiveMigrationNegativeTest-1073271810-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:32:29.636775 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-6c545222-0280-4fcf-899f-86e8a1c7f877 tempest-LiveMigrationNegativeTest-1073271810 tempest-LiveMigrationNegativeTest-1073271810-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:32:29.637500 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-6c545222-0280-4fcf-899f-86e8a1c7f877 tempest-LiveMigrationNegativeTest-1073271810 tempest-LiveMigrationNegativeTest-1073271810-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:32:29.639472 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-6c545222-0280-4fcf-899f-86e8a1c7f877 tempest-LiveMigrationNegativeTest-1073271810 tempest-LiveMigrationNegativeTest-1073271810-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:32:29.701159 n-d-791503-6 nova-conductor[98843]: DEBUG nova.quota [None req-6c545222-0280-4fcf-899f-86e8a1c7f877 tempest-LiveMigrationNegativeTest-1073271810 tempest-LiveMigrationNegativeTest-1073271810-project] Getting quotas for project 9ff0c754879d465cb53258c6273b353b. Resources: {'cores', 'ram', 'instances'} {{(pid=98843) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 13:32:29.708878 n-d-791503-6 nova-conductor[98843]: DEBUG nova.quota [None req-6c545222-0280-4fcf-899f-86e8a1c7f877 tempest-LiveMigrationNegativeTest-1073271810 tempest-LiveMigrationNegativeTest-1073271810-project] Getting quotas for user edcb72dbdecf44629734f5c6167bd605 and project 9ff0c754879d465cb53258c6273b353b. Resources: {'cores', 'ram', 'instances'} {{(pid=98843) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 13:32:29.735105 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-6c545222-0280-4fcf-899f-86e8a1c7f877 tempest-LiveMigrationNegativeTest-1073271810 tempest-LiveMigrationNegativeTest-1073271810-project] [instance: cf096fd1-757b-41db-ae11-db341d5e86b8] Selected host: n-h1-791503-6; Selected node: n-h1-791503-6; Alternates: [('n-h2-791503-6', 'n-h2-791503-6')] {{(pid=98843) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 13:32:29.736102 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-6c545222-0280-4fcf-899f-86e8a1c7f877 tempest-LiveMigrationNegativeTest-1073271810 tempest-LiveMigrationNegativeTest-1073271810-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:32:29.736521 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-6c545222-0280-4fcf-899f-86e8a1c7f877 tempest-LiveMigrationNegativeTest-1073271810 tempest-LiveMigrationNegativeTest-1073271810-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:32:29.750950 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-6c545222-0280-4fcf-899f-86e8a1c7f877 tempest-LiveMigrationNegativeTest-1073271810 tempest-LiveMigrationNegativeTest-1073271810-project] [instance: cf096fd1-757b-41db-ae11-db341d5e86b8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='64f6036b-99a9-40e4-8963-3cdf66964954',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98843) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 13:32:29.753440 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-6c545222-0280-4fcf-899f-86e8a1c7f877 tempest-LiveMigrationNegativeTest-1073271810 tempest-LiveMigrationNegativeTest-1073271810-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:32:29.753848 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-6c545222-0280-4fcf-899f-86e8a1c7f877 tempest-LiveMigrationNegativeTest-1073271810 tempest-LiveMigrationNegativeTest-1073271810-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:32:29.828700 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-6c545222-0280-4fcf-899f-86e8a1c7f877 tempest-LiveMigrationNegativeTest-1073271810 tempest-LiveMigrationNegativeTest-1073271810-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:32:29.829112 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-6c545222-0280-4fcf-899f-86e8a1c7f877 tempest-LiveMigrationNegativeTest-1073271810 tempest-LiveMigrationNegativeTest-1073271810-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:32:40.493125 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.manager [None req-e06bfffc-4734-4eb3-9884-3ed5e7133f4e tempest-ImagesTestJSON-765179807 tempest-ImagesTestJSON-765179807-project] Took 0.70 seconds to select destinations for 1 instance(s). {{(pid=98844) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 13:32:40.574178 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-e06bfffc-4734-4eb3-9884-3ed5e7133f4e tempest-ImagesTestJSON-765179807 tempest-ImagesTestJSON-765179807-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:32:40.575534 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-e06bfffc-4734-4eb3-9884-3ed5e7133f4e tempest-ImagesTestJSON-765179807 tempest-ImagesTestJSON-765179807-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:32:40.691536 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-e06bfffc-4734-4eb3-9884-3ed5e7133f4e tempest-ImagesTestJSON-765179807 tempest-ImagesTestJSON-765179807-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:32:40.692708 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-e06bfffc-4734-4eb3-9884-3ed5e7133f4e tempest-ImagesTestJSON-765179807 tempest-ImagesTestJSON-765179807-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:32:40.694406 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-e06bfffc-4734-4eb3-9884-3ed5e7133f4e tempest-ImagesTestJSON-765179807 tempest-ImagesTestJSON-765179807-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:32:40.695293 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-e06bfffc-4734-4eb3-9884-3ed5e7133f4e tempest-ImagesTestJSON-765179807 tempest-ImagesTestJSON-765179807-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:32:40.731463 n-d-791503-6 nova-conductor[98844]: DEBUG nova.quota [None req-e06bfffc-4734-4eb3-9884-3ed5e7133f4e tempest-ImagesTestJSON-765179807 tempest-ImagesTestJSON-765179807-project] Getting quotas for project 62ce64ceb14d46bdaf4de13da1af2438. Resources: {'cores', 'ram', 'instances'} {{(pid=98844) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 13:32:40.745230 n-d-791503-6 nova-conductor[98844]: DEBUG nova.quota [None req-e06bfffc-4734-4eb3-9884-3ed5e7133f4e tempest-ImagesTestJSON-765179807 tempest-ImagesTestJSON-765179807-project] Getting quotas for user 0a75d696e8d34a7f92cadcaf341f15fa and project 62ce64ceb14d46bdaf4de13da1af2438. Resources: {'cores', 'ram', 'instances'} {{(pid=98844) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 13:32:40.776079 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.manager [None req-e06bfffc-4734-4eb3-9884-3ed5e7133f4e tempest-ImagesTestJSON-765179807 tempest-ImagesTestJSON-765179807-project] [instance: aceda447-7360-4a11-9b09-74310714474c] Selected host: n-h1-791503-6; Selected node: n-h1-791503-6; Alternates: [('n-h2-791503-6', 'n-h2-791503-6')] {{(pid=98844) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 13:32:40.777975 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-e06bfffc-4734-4eb3-9884-3ed5e7133f4e tempest-ImagesTestJSON-765179807 tempest-ImagesTestJSON-765179807-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:32:40.778832 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-e06bfffc-4734-4eb3-9884-3ed5e7133f4e tempest-ImagesTestJSON-765179807 tempest-ImagesTestJSON-765179807-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:32:40.790062 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.manager [None req-e06bfffc-4734-4eb3-9884-3ed5e7133f4e tempest-ImagesTestJSON-765179807 tempest-ImagesTestJSON-765179807-project] [instance: aceda447-7360-4a11-9b09-74310714474c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='64f6036b-99a9-40e4-8963-3cdf66964954',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98844) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 13:32:40.791928 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-e06bfffc-4734-4eb3-9884-3ed5e7133f4e tempest-ImagesTestJSON-765179807 tempest-ImagesTestJSON-765179807-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:32:40.792348 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-e06bfffc-4734-4eb3-9884-3ed5e7133f4e tempest-ImagesTestJSON-765179807 tempest-ImagesTestJSON-765179807-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:32:40.853598 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-e06bfffc-4734-4eb3-9884-3ed5e7133f4e tempest-ImagesTestJSON-765179807 tempest-ImagesTestJSON-765179807-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:32:40.854435 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-e06bfffc-4734-4eb3-9884-3ed5e7133f4e tempest-ImagesTestJSON-765179807 tempest-ImagesTestJSON-765179807-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:32:54.801715 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-2569304c-84d5-4c09-aaf6-4f19b2087e1f tempest-LiveMigrationTest-736720477 tempest-LiveMigrationTest-736720477-project] Took 0.44 seconds to select destinations for 1 instance(s). {{(pid=98843) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 13:32:54.836285 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-2569304c-84d5-4c09-aaf6-4f19b2087e1f tempest-LiveMigrationTest-736720477 tempest-LiveMigrationTest-736720477-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:32:54.836965 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-2569304c-84d5-4c09-aaf6-4f19b2087e1f tempest-LiveMigrationTest-736720477 tempest-LiveMigrationTest-736720477-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:32:54.906927 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-2569304c-84d5-4c09-aaf6-4f19b2087e1f tempest-LiveMigrationTest-736720477 tempest-LiveMigrationTest-736720477-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:32:54.907812 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-2569304c-84d5-4c09-aaf6-4f19b2087e1f tempest-LiveMigrationTest-736720477 tempest-LiveMigrationTest-736720477-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:32:54.908853 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-2569304c-84d5-4c09-aaf6-4f19b2087e1f tempest-LiveMigrationTest-736720477 tempest-LiveMigrationTest-736720477-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:32:54.910114 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-2569304c-84d5-4c09-aaf6-4f19b2087e1f tempest-LiveMigrationTest-736720477 tempest-LiveMigrationTest-736720477-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:32:54.933025 n-d-791503-6 nova-conductor[98843]: DEBUG nova.quota [None req-2569304c-84d5-4c09-aaf6-4f19b2087e1f tempest-LiveMigrationTest-736720477 tempest-LiveMigrationTest-736720477-project] Getting quotas for project 876db6c4b6fe4dfb8d8783136238669a. Resources: {'cores', 'ram', 'instances'} {{(pid=98843) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 13:32:54.938215 n-d-791503-6 nova-conductor[98843]: DEBUG nova.quota [None req-2569304c-84d5-4c09-aaf6-4f19b2087e1f tempest-LiveMigrationTest-736720477 tempest-LiveMigrationTest-736720477-project] Getting quotas for user 26ef8efd255740368f90ec8fa053c9a3 and project 876db6c4b6fe4dfb8d8783136238669a. Resources: {'cores', 'ram', 'instances'} {{(pid=98843) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 13:32:54.950986 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-2569304c-84d5-4c09-aaf6-4f19b2087e1f tempest-LiveMigrationTest-736720477 tempest-LiveMigrationTest-736720477-project] [instance: 4c4ca07c-e415-417e-a835-bf9e1b1714c9] Selected host: n-h2-791503-6; Selected node: n-h2-791503-6; Alternates: [('n-h1-791503-6', 'n-h1-791503-6')] {{(pid=98843) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 13:32:54.952097 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-2569304c-84d5-4c09-aaf6-4f19b2087e1f tempest-LiveMigrationTest-736720477 tempest-LiveMigrationTest-736720477-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:32:54.952679 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-2569304c-84d5-4c09-aaf6-4f19b2087e1f tempest-LiveMigrationTest-736720477 tempest-LiveMigrationTest-736720477-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:32:54.965403 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-2569304c-84d5-4c09-aaf6-4f19b2087e1f tempest-LiveMigrationTest-736720477 tempest-LiveMigrationTest-736720477-project] [instance: 4c4ca07c-e415-417e-a835-bf9e1b1714c9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='64f6036b-99a9-40e4-8963-3cdf66964954',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98843) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 13:32:54.969421 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-2569304c-84d5-4c09-aaf6-4f19b2087e1f tempest-LiveMigrationTest-736720477 tempest-LiveMigrationTest-736720477-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:32:54.970011 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-2569304c-84d5-4c09-aaf6-4f19b2087e1f tempest-LiveMigrationTest-736720477 tempest-LiveMigrationTest-736720477-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:32:55.017383 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-2569304c-84d5-4c09-aaf6-4f19b2087e1f tempest-LiveMigrationTest-736720477 tempest-LiveMigrationTest-736720477-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:32:55.017649 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-2569304c-84d5-4c09-aaf6-4f19b2087e1f tempest-LiveMigrationTest-736720477 tempest-LiveMigrationTest-736720477-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:32:55.943016 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.manager [None req-9d06c88e-46bb-44a6-b023-e775818e618b tempest-LiveAutoBlockMigrationV225Test-1477466171 tempest-LiveAutoBlockMigrationV225Test-1477466171-project] Took 0.47 seconds to select destinations for 1 instance(s). {{(pid=98844) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 13:32:56.001488 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-9d06c88e-46bb-44a6-b023-e775818e618b tempest-LiveAutoBlockMigrationV225Test-1477466171 tempest-LiveAutoBlockMigrationV225Test-1477466171-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:32:56.002674 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-9d06c88e-46bb-44a6-b023-e775818e618b tempest-LiveAutoBlockMigrationV225Test-1477466171 tempest-LiveAutoBlockMigrationV225Test-1477466171-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:32:56.103223 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-9d06c88e-46bb-44a6-b023-e775818e618b tempest-LiveAutoBlockMigrationV225Test-1477466171 tempest-LiveAutoBlockMigrationV225Test-1477466171-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:32:56.104039 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-9d06c88e-46bb-44a6-b023-e775818e618b tempest-LiveAutoBlockMigrationV225Test-1477466171 tempest-LiveAutoBlockMigrationV225Test-1477466171-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:32:56.105679 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-9d06c88e-46bb-44a6-b023-e775818e618b tempest-LiveAutoBlockMigrationV225Test-1477466171 tempest-LiveAutoBlockMigrationV225Test-1477466171-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:32:56.108244 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-9d06c88e-46bb-44a6-b023-e775818e618b tempest-LiveAutoBlockMigrationV225Test-1477466171 tempest-LiveAutoBlockMigrationV225Test-1477466171-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:32:56.149731 n-d-791503-6 nova-conductor[98844]: DEBUG nova.quota [None req-9d06c88e-46bb-44a6-b023-e775818e618b tempest-LiveAutoBlockMigrationV225Test-1477466171 tempest-LiveAutoBlockMigrationV225Test-1477466171-project] Getting quotas for project 7196124f74dc4f2182b1810bc09cdad0. Resources: {'cores', 'ram', 'instances'} {{(pid=98844) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 13:32:56.163336 n-d-791503-6 nova-conductor[98844]: DEBUG nova.quota [None req-9d06c88e-46bb-44a6-b023-e775818e618b tempest-LiveAutoBlockMigrationV225Test-1477466171 tempest-LiveAutoBlockMigrationV225Test-1477466171-project] Getting quotas for user d6f8e0f353fb4d25b3345c954b120a5e and project 7196124f74dc4f2182b1810bc09cdad0. Resources: {'cores', 'ram', 'instances'} {{(pid=98844) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 13:32:56.184687 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.manager [None req-9d06c88e-46bb-44a6-b023-e775818e618b tempest-LiveAutoBlockMigrationV225Test-1477466171 tempest-LiveAutoBlockMigrationV225Test-1477466171-project] [instance: ac03f9f9-ae09-457e-8501-307aaa93b7a9] Selected host: n-h2-791503-6; Selected node: n-h2-791503-6; Alternates: [('n-h1-791503-6', 'n-h1-791503-6')] {{(pid=98844) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 13:32:56.187510 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-9d06c88e-46bb-44a6-b023-e775818e618b tempest-LiveAutoBlockMigrationV225Test-1477466171 tempest-LiveAutoBlockMigrationV225Test-1477466171-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:32:56.188644 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-9d06c88e-46bb-44a6-b023-e775818e618b tempest-LiveAutoBlockMigrationV225Test-1477466171 tempest-LiveAutoBlockMigrationV225Test-1477466171-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:32:56.203484 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.manager [None req-9d06c88e-46bb-44a6-b023-e775818e618b tempest-LiveAutoBlockMigrationV225Test-1477466171 tempest-LiveAutoBlockMigrationV225Test-1477466171-project] [instance: ac03f9f9-ae09-457e-8501-307aaa93b7a9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='64f6036b-99a9-40e4-8963-3cdf66964954',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98844) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 13:32:56.207674 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-9d06c88e-46bb-44a6-b023-e775818e618b tempest-LiveAutoBlockMigrationV225Test-1477466171 tempest-LiveAutoBlockMigrationV225Test-1477466171-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:32:56.208965 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-9d06c88e-46bb-44a6-b023-e775818e618b tempest-LiveAutoBlockMigrationV225Test-1477466171 tempest-LiveAutoBlockMigrationV225Test-1477466171-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:32:56.287857 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-9d06c88e-46bb-44a6-b023-e775818e618b tempest-LiveAutoBlockMigrationV225Test-1477466171 tempest-LiveAutoBlockMigrationV225Test-1477466171-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:32:56.289029 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-9d06c88e-46bb-44a6-b023-e775818e618b tempest-LiveAutoBlockMigrationV225Test-1477466171 tempest-LiveAutoBlockMigrationV225Test-1477466171-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:33:15.856079 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-39971656-687d-4928-be8f-1a7b84abd8b5 tempest-LiveMigrationTest-384423165 tempest-LiveMigrationTest-384423165-project-admin] Targeting cell b241212c-c279-4fbb-a1e7-b87889287cbf(cell1) for conductor method migrate_server {{(pid=98843) wrapper /opt/stack/nova/nova/conductor/manager.py:91}} May 28 13:33:15.857785 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-39971656-687d-4928-be8f-1a7b84abd8b5 tempest-LiveMigrationTest-384423165 tempest-LiveMigrationTest-384423165-project-admin] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:33:15.858502 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-39971656-687d-4928-be8f-1a7b84abd8b5 tempest-LiveMigrationTest-384423165 tempest-LiveMigrationTest-384423165-project-admin] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:33:17.494053 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.tasks.migrate [None req-39971656-687d-4928-be8f-1a7b84abd8b5 tempest-LiveMigrationTest-384423165 tempest-LiveMigrationTest-384423165-project-admin] Created allocations for migration 95b4467e-381a-408c-9e32-90ee46c41d6b on 5c5ac110-743a-4b71-a058-d2597ba8e0c9 {{(pid=98843) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} May 28 13:33:17.755365 n-d-791503-6 nova-conductor[98843]: DEBUG nova.scheduler.utils [None req-39971656-687d-4928-be8f-1a7b84abd8b5 tempest-LiveMigrationTest-384423165 tempest-LiveMigrationTest-384423165-project-admin] [instance: 4c4ca07c-e415-417e-a835-bf9e1b1714c9] Instance allocations successfully created on destination node d4341c2e-3ff0-43f5-9b7e-4ec6191a47d4: {'allocations': {'d4341c2e-3ff0-43f5-9b7e-4ec6191a47d4': {'resources': {'VCPU': 1, 'MEMORY_MB': 1024, 'DISK_GB': 1}}}} {{(pid=98843) claim_resources_on_destination /opt/stack/nova/nova/scheduler/utils.py:827}} May 28 13:33:17.756618 n-d-791503-6 nova-conductor[98843]: DEBUG nova.objects.instance [None req-39971656-687d-4928-be8f-1a7b84abd8b5 tempest-LiveMigrationTest-384423165 tempest-LiveMigrationTest-384423165-project-admin] Lazy-loading 'resources' on Instance uuid 4c4ca07c-e415-417e-a835-bf9e1b1714c9 {{(pid=98843) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 28 13:33:17.766628 n-d-791503-6 nova-conductor[98843]: DEBUG nova.objects.instance [None req-39971656-687d-4928-be8f-1a7b84abd8b5 tempest-LiveMigrationTest-384423165 tempest-LiveMigrationTest-384423165-project-admin] Lazy-loading 'pci_requests' on Instance uuid 4c4ca07c-e415-417e-a835-bf9e1b1714c9 {{(pid=98843) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 28 13:33:18.992726 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.tasks.live_migrate [None req-39971656-687d-4928-be8f-1a7b84abd8b5 tempest-LiveMigrationTest-384423165 tempest-LiveMigrationTest-384423165-project-admin] [instance: 4c4ca07c-e415-417e-a835-bf9e1b1714c9] Start binding ports on destination host: n-h1-791503-6 {{(pid=98843) _bind_ports_on_destination /opt/stack/nova/nova/conductor/tasks/live_migrate.py:389}} May 28 13:33:28.359733 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.manager [None req-a94263e5-c786-465b-9e60-29f92b01669d tempest-LiveAutoBlockMigrationV225Test-1459235087 tempest-LiveAutoBlockMigrationV225Test-1459235087-project-admin] Targeting cell b241212c-c279-4fbb-a1e7-b87889287cbf(cell1) for conductor method migrate_server {{(pid=98844) wrapper /opt/stack/nova/nova/conductor/manager.py:91}} May 28 13:33:28.363760 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-a94263e5-c786-465b-9e60-29f92b01669d tempest-LiveAutoBlockMigrationV225Test-1459235087 tempest-LiveAutoBlockMigrationV225Test-1459235087-project-admin] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:33:28.366309 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-a94263e5-c786-465b-9e60-29f92b01669d tempest-LiveAutoBlockMigrationV225Test-1459235087 tempest-LiveAutoBlockMigrationV225Test-1459235087-project-admin] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:33:30.232704 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.tasks.migrate [None req-a94263e5-c786-465b-9e60-29f92b01669d tempest-LiveAutoBlockMigrationV225Test-1459235087 tempest-LiveAutoBlockMigrationV225Test-1459235087-project-admin] Created allocations for migration a2529ad8-cff6-45da-bcbc-ec5039385e9d on 5c5ac110-743a-4b71-a058-d2597ba8e0c9 {{(pid=98844) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} May 28 13:33:30.415901 n-d-791503-6 nova-conductor[98844]: DEBUG nova.scheduler.utils [None req-a94263e5-c786-465b-9e60-29f92b01669d tempest-LiveAutoBlockMigrationV225Test-1459235087 tempest-LiveAutoBlockMigrationV225Test-1459235087-project-admin] [instance: ac03f9f9-ae09-457e-8501-307aaa93b7a9] Instance allocations successfully created on destination node d4341c2e-3ff0-43f5-9b7e-4ec6191a47d4: {'allocations': {'d4341c2e-3ff0-43f5-9b7e-4ec6191a47d4': {'resources': {'VCPU': 1, 'MEMORY_MB': 1024, 'DISK_GB': 1}}}} {{(pid=98844) claim_resources_on_destination /opt/stack/nova/nova/scheduler/utils.py:827}} May 28 13:33:30.416751 n-d-791503-6 nova-conductor[98844]: DEBUG nova.objects.instance [None req-a94263e5-c786-465b-9e60-29f92b01669d tempest-LiveAutoBlockMigrationV225Test-1459235087 tempest-LiveAutoBlockMigrationV225Test-1459235087-project-admin] Lazy-loading 'resources' on Instance uuid ac03f9f9-ae09-457e-8501-307aaa93b7a9 {{(pid=98844) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 28 13:33:30.423052 n-d-791503-6 nova-conductor[98844]: DEBUG nova.objects.instance [None req-a94263e5-c786-465b-9e60-29f92b01669d tempest-LiveAutoBlockMigrationV225Test-1459235087 tempest-LiveAutoBlockMigrationV225Test-1459235087-project-admin] Lazy-loading 'pci_requests' on Instance uuid ac03f9f9-ae09-457e-8501-307aaa93b7a9 {{(pid=98844) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 28 13:33:31.175484 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.tasks.live_migrate [None req-a94263e5-c786-465b-9e60-29f92b01669d tempest-LiveAutoBlockMigrationV225Test-1459235087 tempest-LiveAutoBlockMigrationV225Test-1459235087-project-admin] [instance: ac03f9f9-ae09-457e-8501-307aaa93b7a9] Start binding ports on destination host: n-h1-791503-6 {{(pid=98844) _bind_ports_on_destination /opt/stack/nova/nova/conductor/tasks/live_migrate.py:389}} May 28 13:33:36.650470 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-4083a85c-c8b0-4e90-95c3-92ed2444dbaa tempest-TenantUsagesTestJSON-252962145 tempest-TenantUsagesTestJSON-252962145-project] Took 0.64 seconds to select destinations for 1 instance(s). {{(pid=98843) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 13:33:36.730308 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-4083a85c-c8b0-4e90-95c3-92ed2444dbaa tempest-TenantUsagesTestJSON-252962145 tempest-TenantUsagesTestJSON-252962145-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:33:36.730921 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-4083a85c-c8b0-4e90-95c3-92ed2444dbaa tempest-TenantUsagesTestJSON-252962145 tempest-TenantUsagesTestJSON-252962145-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:33:36.872180 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-4083a85c-c8b0-4e90-95c3-92ed2444dbaa tempest-TenantUsagesTestJSON-252962145 tempest-TenantUsagesTestJSON-252962145-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:33:36.872595 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-4083a85c-c8b0-4e90-95c3-92ed2444dbaa tempest-TenantUsagesTestJSON-252962145 tempest-TenantUsagesTestJSON-252962145-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:33:36.874235 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-4083a85c-c8b0-4e90-95c3-92ed2444dbaa tempest-TenantUsagesTestJSON-252962145 tempest-TenantUsagesTestJSON-252962145-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:33:36.874638 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-4083a85c-c8b0-4e90-95c3-92ed2444dbaa tempest-TenantUsagesTestJSON-252962145 tempest-TenantUsagesTestJSON-252962145-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:33:36.907256 n-d-791503-6 nova-conductor[98843]: DEBUG nova.quota [None req-4083a85c-c8b0-4e90-95c3-92ed2444dbaa tempest-TenantUsagesTestJSON-252962145 tempest-TenantUsagesTestJSON-252962145-project] Getting quotas for project af0280320e7b47078a3f999833e98dd4. Resources: {'cores', 'ram', 'instances'} {{(pid=98843) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 13:33:36.914670 n-d-791503-6 nova-conductor[98843]: DEBUG nova.quota [None req-4083a85c-c8b0-4e90-95c3-92ed2444dbaa tempest-TenantUsagesTestJSON-252962145 tempest-TenantUsagesTestJSON-252962145-project] Getting quotas for user ddfade00de85414f8489ee7ff5b6c3f9 and project af0280320e7b47078a3f999833e98dd4. Resources: {'cores', 'ram', 'instances'} {{(pid=98843) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 13:33:36.935900 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-4083a85c-c8b0-4e90-95c3-92ed2444dbaa tempest-TenantUsagesTestJSON-252962145 tempest-TenantUsagesTestJSON-252962145-project] [instance: 05315584-a8d1-46f2-a101-47b8c9c33899] Selected host: n-h1-791503-6; Selected node: n-h1-791503-6; Alternates: [('n-h2-791503-6', 'n-h2-791503-6')] {{(pid=98843) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 13:33:36.937677 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-4083a85c-c8b0-4e90-95c3-92ed2444dbaa tempest-TenantUsagesTestJSON-252962145 tempest-TenantUsagesTestJSON-252962145-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:33:36.938107 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-4083a85c-c8b0-4e90-95c3-92ed2444dbaa tempest-TenantUsagesTestJSON-252962145 tempest-TenantUsagesTestJSON-252962145-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:33:36.982863 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-4083a85c-c8b0-4e90-95c3-92ed2444dbaa tempest-TenantUsagesTestJSON-252962145 tempest-TenantUsagesTestJSON-252962145-project] [instance: 05315584-a8d1-46f2-a101-47b8c9c33899] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='64f6036b-99a9-40e4-8963-3cdf66964954',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98843) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 13:33:36.984720 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-4083a85c-c8b0-4e90-95c3-92ed2444dbaa tempest-TenantUsagesTestJSON-252962145 tempest-TenantUsagesTestJSON-252962145-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:33:36.992230 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-4083a85c-c8b0-4e90-95c3-92ed2444dbaa tempest-TenantUsagesTestJSON-252962145 tempest-TenantUsagesTestJSON-252962145-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:33:37.097711 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-4083a85c-c8b0-4e90-95c3-92ed2444dbaa tempest-TenantUsagesTestJSON-252962145 tempest-TenantUsagesTestJSON-252962145-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:33:37.099053 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-4083a85c-c8b0-4e90-95c3-92ed2444dbaa tempest-TenantUsagesTestJSON-252962145 tempest-TenantUsagesTestJSON-252962145-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:33:58.306345 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.manager [None req-60159c65-0fb0-4d19-9399-d7a3d9974fbc tempest-ImagesTestJSON-765179807 tempest-ImagesTestJSON-765179807-project] Took 0.67 seconds to select destinations for 1 instance(s). {{(pid=98844) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 13:33:58.350466 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-60159c65-0fb0-4d19-9399-d7a3d9974fbc tempest-ImagesTestJSON-765179807 tempest-ImagesTestJSON-765179807-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:33:58.351136 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-60159c65-0fb0-4d19-9399-d7a3d9974fbc tempest-ImagesTestJSON-765179807 tempest-ImagesTestJSON-765179807-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:33:58.416577 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-60159c65-0fb0-4d19-9399-d7a3d9974fbc tempest-ImagesTestJSON-765179807 tempest-ImagesTestJSON-765179807-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:33:58.417006 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-60159c65-0fb0-4d19-9399-d7a3d9974fbc tempest-ImagesTestJSON-765179807 tempest-ImagesTestJSON-765179807-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:33:58.417760 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-60159c65-0fb0-4d19-9399-d7a3d9974fbc tempest-ImagesTestJSON-765179807 tempest-ImagesTestJSON-765179807-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:33:58.418265 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-60159c65-0fb0-4d19-9399-d7a3d9974fbc tempest-ImagesTestJSON-765179807 tempest-ImagesTestJSON-765179807-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:33:58.460541 n-d-791503-6 nova-conductor[98844]: DEBUG nova.quota [None req-60159c65-0fb0-4d19-9399-d7a3d9974fbc tempest-ImagesTestJSON-765179807 tempest-ImagesTestJSON-765179807-project] Getting quotas for project 62ce64ceb14d46bdaf4de13da1af2438. Resources: {'cores', 'ram', 'instances'} {{(pid=98844) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 13:33:58.469100 n-d-791503-6 nova-conductor[98844]: DEBUG nova.quota [None req-60159c65-0fb0-4d19-9399-d7a3d9974fbc tempest-ImagesTestJSON-765179807 tempest-ImagesTestJSON-765179807-project] Getting quotas for user 0a75d696e8d34a7f92cadcaf341f15fa and project 62ce64ceb14d46bdaf4de13da1af2438. Resources: {'cores', 'ram', 'instances'} {{(pid=98844) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 13:33:58.487515 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.manager [None req-60159c65-0fb0-4d19-9399-d7a3d9974fbc tempest-ImagesTestJSON-765179807 tempest-ImagesTestJSON-765179807-project] [instance: 768d2ea4-6c99-4f30-9f8a-c8ecff9ecff8] Selected host: n-h2-791503-6; Selected node: n-h2-791503-6; Alternates: [('n-h1-791503-6', 'n-h1-791503-6')] {{(pid=98844) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 13:33:58.488933 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-60159c65-0fb0-4d19-9399-d7a3d9974fbc tempest-ImagesTestJSON-765179807 tempest-ImagesTestJSON-765179807-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:33:58.489393 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-60159c65-0fb0-4d19-9399-d7a3d9974fbc tempest-ImagesTestJSON-765179807 tempest-ImagesTestJSON-765179807-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:33:58.502728 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.manager [None req-60159c65-0fb0-4d19-9399-d7a3d9974fbc tempest-ImagesTestJSON-765179807 tempest-ImagesTestJSON-765179807-project] [instance: 768d2ea4-6c99-4f30-9f8a-c8ecff9ecff8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='64f6036b-99a9-40e4-8963-3cdf66964954',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98844) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 13:33:58.504296 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-60159c65-0fb0-4d19-9399-d7a3d9974fbc tempest-ImagesTestJSON-765179807 tempest-ImagesTestJSON-765179807-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:33:58.504937 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-60159c65-0fb0-4d19-9399-d7a3d9974fbc tempest-ImagesTestJSON-765179807 tempest-ImagesTestJSON-765179807-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:33:58.559146 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-60159c65-0fb0-4d19-9399-d7a3d9974fbc tempest-ImagesTestJSON-765179807 tempest-ImagesTestJSON-765179807-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:33:58.559589 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-60159c65-0fb0-4d19-9399-d7a3d9974fbc tempest-ImagesTestJSON-765179807 tempest-ImagesTestJSON-765179807-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:34:02.673709 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-19c96002-d631-4857-877c-4875c9253451 tempest-LiveMigrationTest-736720477 tempest-LiveMigrationTest-736720477-project] Took 0.56 seconds to select destinations for 1 instance(s). {{(pid=98843) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 13:34:02.727570 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-19c96002-d631-4857-877c-4875c9253451 tempest-LiveMigrationTest-736720477 tempest-LiveMigrationTest-736720477-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:34:02.728553 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-19c96002-d631-4857-877c-4875c9253451 tempest-LiveMigrationTest-736720477 tempest-LiveMigrationTest-736720477-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:34:02.795734 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-19c96002-d631-4857-877c-4875c9253451 tempest-LiveMigrationTest-736720477 tempest-LiveMigrationTest-736720477-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:34:02.796604 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-19c96002-d631-4857-877c-4875c9253451 tempest-LiveMigrationTest-736720477 tempest-LiveMigrationTest-736720477-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:34:02.797870 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-19c96002-d631-4857-877c-4875c9253451 tempest-LiveMigrationTest-736720477 tempest-LiveMigrationTest-736720477-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:34:02.798433 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-19c96002-d631-4857-877c-4875c9253451 tempest-LiveMigrationTest-736720477 tempest-LiveMigrationTest-736720477-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:34:02.823346 n-d-791503-6 nova-conductor[98843]: DEBUG nova.quota [None req-19c96002-d631-4857-877c-4875c9253451 tempest-LiveMigrationTest-736720477 tempest-LiveMigrationTest-736720477-project] Getting quotas for project 876db6c4b6fe4dfb8d8783136238669a. Resources: {'cores', 'ram', 'instances'} {{(pid=98843) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 13:34:02.830978 n-d-791503-6 nova-conductor[98843]: DEBUG nova.quota [None req-19c96002-d631-4857-877c-4875c9253451 tempest-LiveMigrationTest-736720477 tempest-LiveMigrationTest-736720477-project] Getting quotas for user 26ef8efd255740368f90ec8fa053c9a3 and project 876db6c4b6fe4dfb8d8783136238669a. Resources: {'cores', 'ram', 'instances'} {{(pid=98843) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 13:34:02.852323 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-19c96002-d631-4857-877c-4875c9253451 tempest-LiveMigrationTest-736720477 tempest-LiveMigrationTest-736720477-project] [instance: 2994ed31-07bd-4590-a5f7-4608299252e9] Selected host: n-h2-791503-6; Selected node: n-h2-791503-6; Alternates: [('n-h1-791503-6', 'n-h1-791503-6')] {{(pid=98843) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 13:34:02.853581 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-19c96002-d631-4857-877c-4875c9253451 tempest-LiveMigrationTest-736720477 tempest-LiveMigrationTest-736720477-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:34:02.854718 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-19c96002-d631-4857-877c-4875c9253451 tempest-LiveMigrationTest-736720477 tempest-LiveMigrationTest-736720477-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:34:02.867243 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-19c96002-d631-4857-877c-4875c9253451 tempest-LiveMigrationTest-736720477 tempest-LiveMigrationTest-736720477-project] [instance: 2994ed31-07bd-4590-a5f7-4608299252e9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='64f6036b-99a9-40e4-8963-3cdf66964954',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98843) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 13:34:02.869519 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-19c96002-d631-4857-877c-4875c9253451 tempest-LiveMigrationTest-736720477 tempest-LiveMigrationTest-736720477-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:34:02.870596 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-19c96002-d631-4857-877c-4875c9253451 tempest-LiveMigrationTest-736720477 tempest-LiveMigrationTest-736720477-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:34:02.930753 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-19c96002-d631-4857-877c-4875c9253451 tempest-LiveMigrationTest-736720477 tempest-LiveMigrationTest-736720477-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:34:02.933038 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-19c96002-d631-4857-877c-4875c9253451 tempest-LiveMigrationTest-736720477 tempest-LiveMigrationTest-736720477-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:34:16.374666 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.manager [None req-fe8b3167-f109-4490-8b9e-c6ddcd2237ff tempest-ImagesOneServerTestJSON-1494343571 tempest-ImagesOneServerTestJSON-1494343571-project] Took 0.67 seconds to select destinations for 1 instance(s). {{(pid=98844) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 13:34:16.462747 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-fe8b3167-f109-4490-8b9e-c6ddcd2237ff tempest-ImagesOneServerTestJSON-1494343571 tempest-ImagesOneServerTestJSON-1494343571-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:34:16.465462 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-fe8b3167-f109-4490-8b9e-c6ddcd2237ff tempest-ImagesOneServerTestJSON-1494343571 tempest-ImagesOneServerTestJSON-1494343571-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:34:16.612765 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-fe8b3167-f109-4490-8b9e-c6ddcd2237ff tempest-ImagesOneServerTestJSON-1494343571 tempest-ImagesOneServerTestJSON-1494343571-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:34:16.613437 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-fe8b3167-f109-4490-8b9e-c6ddcd2237ff tempest-ImagesOneServerTestJSON-1494343571 tempest-ImagesOneServerTestJSON-1494343571-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:34:16.614628 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-fe8b3167-f109-4490-8b9e-c6ddcd2237ff tempest-ImagesOneServerTestJSON-1494343571 tempest-ImagesOneServerTestJSON-1494343571-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:34:16.615343 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-fe8b3167-f109-4490-8b9e-c6ddcd2237ff tempest-ImagesOneServerTestJSON-1494343571 tempest-ImagesOneServerTestJSON-1494343571-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:34:16.659482 n-d-791503-6 nova-conductor[98844]: DEBUG nova.quota [None req-fe8b3167-f109-4490-8b9e-c6ddcd2237ff tempest-ImagesOneServerTestJSON-1494343571 tempest-ImagesOneServerTestJSON-1494343571-project] Getting quotas for project dd4ac1a51a5b458eb8aa31247e330bad. Resources: {'cores', 'ram', 'instances'} {{(pid=98844) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 13:34:16.670168 n-d-791503-6 nova-conductor[98844]: DEBUG nova.quota [None req-fe8b3167-f109-4490-8b9e-c6ddcd2237ff tempest-ImagesOneServerTestJSON-1494343571 tempest-ImagesOneServerTestJSON-1494343571-project] Getting quotas for user 5135f6c92945497c936f9e8e3d3de9a8 and project dd4ac1a51a5b458eb8aa31247e330bad. Resources: {'cores', 'ram', 'instances'} {{(pid=98844) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 13:34:16.686080 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.manager [None req-fe8b3167-f109-4490-8b9e-c6ddcd2237ff tempest-ImagesOneServerTestJSON-1494343571 tempest-ImagesOneServerTestJSON-1494343571-project] [instance: 8f8c4dff-9eee-4536-8308-be6fe9190117] Selected host: n-h1-791503-6; Selected node: n-h1-791503-6; Alternates: [('n-h2-791503-6', 'n-h2-791503-6')] {{(pid=98844) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 13:34:16.687925 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-fe8b3167-f109-4490-8b9e-c6ddcd2237ff tempest-ImagesOneServerTestJSON-1494343571 tempest-ImagesOneServerTestJSON-1494343571-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:34:16.688605 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-fe8b3167-f109-4490-8b9e-c6ddcd2237ff tempest-ImagesOneServerTestJSON-1494343571 tempest-ImagesOneServerTestJSON-1494343571-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:34:16.706092 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.manager [None req-fe8b3167-f109-4490-8b9e-c6ddcd2237ff tempest-ImagesOneServerTestJSON-1494343571 tempest-ImagesOneServerTestJSON-1494343571-project] [instance: 8f8c4dff-9eee-4536-8308-be6fe9190117] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='64f6036b-99a9-40e4-8963-3cdf66964954',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98844) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 13:34:16.707623 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-fe8b3167-f109-4490-8b9e-c6ddcd2237ff tempest-ImagesOneServerTestJSON-1494343571 tempest-ImagesOneServerTestJSON-1494343571-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:34:16.708461 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-fe8b3167-f109-4490-8b9e-c6ddcd2237ff tempest-ImagesOneServerTestJSON-1494343571 tempest-ImagesOneServerTestJSON-1494343571-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:34:16.793819 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-fe8b3167-f109-4490-8b9e-c6ddcd2237ff tempest-ImagesOneServerTestJSON-1494343571 tempest-ImagesOneServerTestJSON-1494343571-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:34:16.794821 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-fe8b3167-f109-4490-8b9e-c6ddcd2237ff tempest-ImagesOneServerTestJSON-1494343571 tempest-ImagesOneServerTestJSON-1494343571-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:34:21.576828 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-25674fc2-6fb1-4074-96ce-f322de3a5dcc tempest-VolumesAdminNegativeTest-844633508 tempest-VolumesAdminNegativeTest-844633508-project] Took 0.55 seconds to select destinations for 1 instance(s). {{(pid=98843) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 13:34:21.630066 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-25674fc2-6fb1-4074-96ce-f322de3a5dcc tempest-VolumesAdminNegativeTest-844633508 tempest-VolumesAdminNegativeTest-844633508-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:34:21.631149 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-25674fc2-6fb1-4074-96ce-f322de3a5dcc tempest-VolumesAdminNegativeTest-844633508 tempest-VolumesAdminNegativeTest-844633508-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:34:21.721626 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-25674fc2-6fb1-4074-96ce-f322de3a5dcc tempest-VolumesAdminNegativeTest-844633508 tempest-VolumesAdminNegativeTest-844633508-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:34:21.722111 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-25674fc2-6fb1-4074-96ce-f322de3a5dcc tempest-VolumesAdminNegativeTest-844633508 tempest-VolumesAdminNegativeTest-844633508-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:34:21.723315 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-25674fc2-6fb1-4074-96ce-f322de3a5dcc tempest-VolumesAdminNegativeTest-844633508 tempest-VolumesAdminNegativeTest-844633508-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:34:21.723937 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-25674fc2-6fb1-4074-96ce-f322de3a5dcc tempest-VolumesAdminNegativeTest-844633508 tempest-VolumesAdminNegativeTest-844633508-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:34:21.758465 n-d-791503-6 nova-conductor[98843]: DEBUG nova.quota [None req-25674fc2-6fb1-4074-96ce-f322de3a5dcc tempest-VolumesAdminNegativeTest-844633508 tempest-VolumesAdminNegativeTest-844633508-project] Getting quotas for project e33b922b82c240bab86380df6a5c1971. Resources: {'cores', 'ram', 'instances'} {{(pid=98843) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 13:34:21.770563 n-d-791503-6 nova-conductor[98843]: DEBUG nova.quota [None req-25674fc2-6fb1-4074-96ce-f322de3a5dcc tempest-VolumesAdminNegativeTest-844633508 tempest-VolumesAdminNegativeTest-844633508-project] Getting quotas for user 76ae37d1fd5d448fa8e4386089bfff6b and project e33b922b82c240bab86380df6a5c1971. Resources: {'cores', 'ram', 'instances'} {{(pid=98843) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 13:34:21.795663 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-25674fc2-6fb1-4074-96ce-f322de3a5dcc tempest-VolumesAdminNegativeTest-844633508 tempest-VolumesAdminNegativeTest-844633508-project] [instance: 893facec-e8de-46c8-8446-55b8c5e098d7] Selected host: n-h1-791503-6; Selected node: n-h1-791503-6; Alternates: [('n-h2-791503-6', 'n-h2-791503-6')] {{(pid=98843) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 13:34:21.797824 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-25674fc2-6fb1-4074-96ce-f322de3a5dcc tempest-VolumesAdminNegativeTest-844633508 tempest-VolumesAdminNegativeTest-844633508-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:34:21.798593 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-25674fc2-6fb1-4074-96ce-f322de3a5dcc tempest-VolumesAdminNegativeTest-844633508 tempest-VolumesAdminNegativeTest-844633508-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:34:21.810351 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-25674fc2-6fb1-4074-96ce-f322de3a5dcc tempest-VolumesAdminNegativeTest-844633508 tempest-VolumesAdminNegativeTest-844633508-project] [instance: 893facec-e8de-46c8-8446-55b8c5e098d7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='64f6036b-99a9-40e4-8963-3cdf66964954',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98843) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 13:34:21.813993 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-25674fc2-6fb1-4074-96ce-f322de3a5dcc tempest-VolumesAdminNegativeTest-844633508 tempest-VolumesAdminNegativeTest-844633508-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:34:21.814638 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-25674fc2-6fb1-4074-96ce-f322de3a5dcc tempest-VolumesAdminNegativeTest-844633508 tempest-VolumesAdminNegativeTest-844633508-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:34:21.879950 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-25674fc2-6fb1-4074-96ce-f322de3a5dcc tempest-VolumesAdminNegativeTest-844633508 tempest-VolumesAdminNegativeTest-844633508-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:34:21.880941 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-25674fc2-6fb1-4074-96ce-f322de3a5dcc tempest-VolumesAdminNegativeTest-844633508 tempest-VolumesAdminNegativeTest-844633508-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:34:23.090651 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.manager [None req-c8a2ea9a-00eb-4f2b-b0d7-6d801552838d tempest-LiveAutoBlockMigrationV225Test-1477466171 tempest-LiveAutoBlockMigrationV225Test-1477466171-project] Took 0.78 seconds to select destinations for 1 instance(s). {{(pid=98844) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 13:34:23.131496 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-c8a2ea9a-00eb-4f2b-b0d7-6d801552838d tempest-LiveAutoBlockMigrationV225Test-1477466171 tempest-LiveAutoBlockMigrationV225Test-1477466171-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:34:23.132843 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-c8a2ea9a-00eb-4f2b-b0d7-6d801552838d tempest-LiveAutoBlockMigrationV225Test-1477466171 tempest-LiveAutoBlockMigrationV225Test-1477466171-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:34:23.214721 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-c8a2ea9a-00eb-4f2b-b0d7-6d801552838d tempest-LiveAutoBlockMigrationV225Test-1477466171 tempest-LiveAutoBlockMigrationV225Test-1477466171-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:34:23.215839 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-c8a2ea9a-00eb-4f2b-b0d7-6d801552838d tempest-LiveAutoBlockMigrationV225Test-1477466171 tempest-LiveAutoBlockMigrationV225Test-1477466171-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:34:23.217657 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-c8a2ea9a-00eb-4f2b-b0d7-6d801552838d tempest-LiveAutoBlockMigrationV225Test-1477466171 tempest-LiveAutoBlockMigrationV225Test-1477466171-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:34:23.218681 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-c8a2ea9a-00eb-4f2b-b0d7-6d801552838d tempest-LiveAutoBlockMigrationV225Test-1477466171 tempest-LiveAutoBlockMigrationV225Test-1477466171-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:34:23.264232 n-d-791503-6 nova-conductor[98844]: DEBUG nova.quota [None req-c8a2ea9a-00eb-4f2b-b0d7-6d801552838d tempest-LiveAutoBlockMigrationV225Test-1477466171 tempest-LiveAutoBlockMigrationV225Test-1477466171-project] Getting quotas for project 7196124f74dc4f2182b1810bc09cdad0. Resources: {'cores', 'ram', 'instances'} {{(pid=98844) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 13:34:23.274779 n-d-791503-6 nova-conductor[98844]: DEBUG nova.quota [None req-c8a2ea9a-00eb-4f2b-b0d7-6d801552838d tempest-LiveAutoBlockMigrationV225Test-1477466171 tempest-LiveAutoBlockMigrationV225Test-1477466171-project] Getting quotas for user d6f8e0f353fb4d25b3345c954b120a5e and project 7196124f74dc4f2182b1810bc09cdad0. Resources: {'cores', 'ram', 'instances'} {{(pid=98844) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 13:34:23.297497 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.manager [None req-c8a2ea9a-00eb-4f2b-b0d7-6d801552838d tempest-LiveAutoBlockMigrationV225Test-1477466171 tempest-LiveAutoBlockMigrationV225Test-1477466171-project] [instance: 1e577ff8-dc8c-4f42-93c8-5bd54c39d082] Selected host: n-h1-791503-6; Selected node: n-h1-791503-6; Alternates: [('n-h2-791503-6', 'n-h2-791503-6')] {{(pid=98844) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 13:34:23.299962 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-c8a2ea9a-00eb-4f2b-b0d7-6d801552838d tempest-LiveAutoBlockMigrationV225Test-1477466171 tempest-LiveAutoBlockMigrationV225Test-1477466171-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:34:23.300753 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-c8a2ea9a-00eb-4f2b-b0d7-6d801552838d tempest-LiveAutoBlockMigrationV225Test-1477466171 tempest-LiveAutoBlockMigrationV225Test-1477466171-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:34:23.314762 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.manager [None req-c8a2ea9a-00eb-4f2b-b0d7-6d801552838d tempest-LiveAutoBlockMigrationV225Test-1477466171 tempest-LiveAutoBlockMigrationV225Test-1477466171-project] [instance: 1e577ff8-dc8c-4f42-93c8-5bd54c39d082] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='64f6036b-99a9-40e4-8963-3cdf66964954',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98844) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 13:34:23.317843 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-c8a2ea9a-00eb-4f2b-b0d7-6d801552838d tempest-LiveAutoBlockMigrationV225Test-1477466171 tempest-LiveAutoBlockMigrationV225Test-1477466171-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:34:23.318957 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-c8a2ea9a-00eb-4f2b-b0d7-6d801552838d tempest-LiveAutoBlockMigrationV225Test-1477466171 tempest-LiveAutoBlockMigrationV225Test-1477466171-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:34:23.402610 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-c8a2ea9a-00eb-4f2b-b0d7-6d801552838d tempest-LiveAutoBlockMigrationV225Test-1477466171 tempest-LiveAutoBlockMigrationV225Test-1477466171-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:34:23.403850 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-c8a2ea9a-00eb-4f2b-b0d7-6d801552838d tempest-LiveAutoBlockMigrationV225Test-1477466171 tempest-LiveAutoBlockMigrationV225Test-1477466171-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:34:37.064281 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-a96a7e57-7b57-43da-8327-95d0793055b4 tempest-LiveMigrationTest-384423165 tempest-LiveMigrationTest-384423165-project-admin] Targeting cell b241212c-c279-4fbb-a1e7-b87889287cbf(cell1) for conductor method migrate_server {{(pid=98843) wrapper /opt/stack/nova/nova/conductor/manager.py:91}} May 28 13:34:37.065354 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-a96a7e57-7b57-43da-8327-95d0793055b4 tempest-LiveMigrationTest-384423165 tempest-LiveMigrationTest-384423165-project-admin] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:34:37.066210 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-a96a7e57-7b57-43da-8327-95d0793055b4 tempest-LiveMigrationTest-384423165 tempest-LiveMigrationTest-384423165-project-admin] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:34:38.036432 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.tasks.migrate [None req-a96a7e57-7b57-43da-8327-95d0793055b4 tempest-LiveMigrationTest-384423165 tempest-LiveMigrationTest-384423165-project-admin] Created allocations for migration 07162d97-210b-42c8-ba8b-28826690cb55 on 5c5ac110-743a-4b71-a058-d2597ba8e0c9 {{(pid=98843) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} May 28 13:34:38.296865 n-d-791503-6 nova-conductor[98843]: DEBUG nova.scheduler.utils [None req-a96a7e57-7b57-43da-8327-95d0793055b4 tempest-LiveMigrationTest-384423165 tempest-LiveMigrationTest-384423165-project-admin] [instance: 2994ed31-07bd-4590-a5f7-4608299252e9] Instance allocations successfully created on destination node d4341c2e-3ff0-43f5-9b7e-4ec6191a47d4: {'allocations': {'d4341c2e-3ff0-43f5-9b7e-4ec6191a47d4': {'resources': {'VCPU': 1, 'MEMORY_MB': 1024, 'DISK_GB': 1}}}} {{(pid=98843) claim_resources_on_destination /opt/stack/nova/nova/scheduler/utils.py:827}} May 28 13:34:38.300337 n-d-791503-6 nova-conductor[98843]: DEBUG nova.objects.instance [None req-a96a7e57-7b57-43da-8327-95d0793055b4 tempest-LiveMigrationTest-384423165 tempest-LiveMigrationTest-384423165-project-admin] Lazy-loading 'resources' on Instance uuid 2994ed31-07bd-4590-a5f7-4608299252e9 {{(pid=98843) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 28 13:34:38.316893 n-d-791503-6 nova-conductor[98843]: DEBUG nova.objects.instance [None req-a96a7e57-7b57-43da-8327-95d0793055b4 tempest-LiveMigrationTest-384423165 tempest-LiveMigrationTest-384423165-project-admin] Lazy-loading 'pci_requests' on Instance uuid 2994ed31-07bd-4590-a5f7-4608299252e9 {{(pid=98843) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 28 13:34:38.829526 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.tasks.live_migrate [None req-a96a7e57-7b57-43da-8327-95d0793055b4 tempest-LiveMigrationTest-384423165 tempest-LiveMigrationTest-384423165-project-admin] [instance: 2994ed31-07bd-4590-a5f7-4608299252e9] Start binding ports on destination host: n-h1-791503-6 {{(pid=98843) _bind_ports_on_destination /opt/stack/nova/nova/conductor/tasks/live_migrate.py:389}} May 28 13:35:00.696865 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.manager [None req-f849a0dd-acde-4e2b-b15c-00b43c1c07df tempest-ServersWithSpecificFlavorTestJSON-1001305181 tempest-ServersWithSpecificFlavorTestJSON-1001305181-project] Took 0.66 seconds to select destinations for 1 instance(s). {{(pid=98844) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 13:35:00.774205 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-f849a0dd-acde-4e2b-b15c-00b43c1c07df tempest-ServersWithSpecificFlavorTestJSON-1001305181 tempest-ServersWithSpecificFlavorTestJSON-1001305181-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:35:00.775439 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-f849a0dd-acde-4e2b-b15c-00b43c1c07df tempest-ServersWithSpecificFlavorTestJSON-1001305181 tempest-ServersWithSpecificFlavorTestJSON-1001305181-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:35:00.912511 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-f849a0dd-acde-4e2b-b15c-00b43c1c07df tempest-ServersWithSpecificFlavorTestJSON-1001305181 tempest-ServersWithSpecificFlavorTestJSON-1001305181-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:35:00.913483 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-f849a0dd-acde-4e2b-b15c-00b43c1c07df tempest-ServersWithSpecificFlavorTestJSON-1001305181 tempest-ServersWithSpecificFlavorTestJSON-1001305181-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:35:00.916320 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-f849a0dd-acde-4e2b-b15c-00b43c1c07df tempest-ServersWithSpecificFlavorTestJSON-1001305181 tempest-ServersWithSpecificFlavorTestJSON-1001305181-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:35:00.917644 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-f849a0dd-acde-4e2b-b15c-00b43c1c07df tempest-ServersWithSpecificFlavorTestJSON-1001305181 tempest-ServersWithSpecificFlavorTestJSON-1001305181-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:35:00.968289 n-d-791503-6 nova-conductor[98844]: DEBUG nova.quota [None req-f849a0dd-acde-4e2b-b15c-00b43c1c07df tempest-ServersWithSpecificFlavorTestJSON-1001305181 tempest-ServersWithSpecificFlavorTestJSON-1001305181-project] Getting quotas for project 1a63ef5eb4bc415c8d016fa4f214ba55. Resources: {'cores', 'ram', 'instances'} {{(pid=98844) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 13:35:00.985257 n-d-791503-6 nova-conductor[98844]: DEBUG nova.quota [None req-f849a0dd-acde-4e2b-b15c-00b43c1c07df tempest-ServersWithSpecificFlavorTestJSON-1001305181 tempest-ServersWithSpecificFlavorTestJSON-1001305181-project] Getting quotas for user f46f4d9926b349459955bf63a7c3f857 and project 1a63ef5eb4bc415c8d016fa4f214ba55. Resources: {'cores', 'ram', 'instances'} {{(pid=98844) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 13:35:01.012194 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.manager [None req-f849a0dd-acde-4e2b-b15c-00b43c1c07df tempest-ServersWithSpecificFlavorTestJSON-1001305181 tempest-ServersWithSpecificFlavorTestJSON-1001305181-project] [instance: ad181516-4661-4aec-a3e7-704e63ab2cd6] Selected host: n-h2-791503-6; Selected node: n-h2-791503-6; Alternates: [('n-h1-791503-6', 'n-h1-791503-6')] {{(pid=98844) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 13:35:01.020052 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-f849a0dd-acde-4e2b-b15c-00b43c1c07df tempest-ServersWithSpecificFlavorTestJSON-1001305181 tempest-ServersWithSpecificFlavorTestJSON-1001305181-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:35:01.021164 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-f849a0dd-acde-4e2b-b15c-00b43c1c07df tempest-ServersWithSpecificFlavorTestJSON-1001305181 tempest-ServersWithSpecificFlavorTestJSON-1001305181-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:35:01.051531 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.manager [None req-f849a0dd-acde-4e2b-b15c-00b43c1c07df tempest-ServersWithSpecificFlavorTestJSON-1001305181 tempest-ServersWithSpecificFlavorTestJSON-1001305181-project] [instance: ad181516-4661-4aec-a3e7-704e63ab2cd6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='64f6036b-99a9-40e4-8963-3cdf66964954',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=-1,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=98844) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 13:35:01.068334 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-f849a0dd-acde-4e2b-b15c-00b43c1c07df tempest-ServersWithSpecificFlavorTestJSON-1001305181 tempest-ServersWithSpecificFlavorTestJSON-1001305181-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:35:01.068754 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-f849a0dd-acde-4e2b-b15c-00b43c1c07df tempest-ServersWithSpecificFlavorTestJSON-1001305181 tempest-ServersWithSpecificFlavorTestJSON-1001305181-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:35:01.087527 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-f849a0dd-acde-4e2b-b15c-00b43c1c07df tempest-ServersWithSpecificFlavorTestJSON-1001305181 tempest-ServersWithSpecificFlavorTestJSON-1001305181-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:35:01.088366 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-f849a0dd-acde-4e2b-b15c-00b43c1c07df tempest-ServersWithSpecificFlavorTestJSON-1001305181 tempest-ServersWithSpecificFlavorTestJSON-1001305181-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:35:01.149148 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-f849a0dd-acde-4e2b-b15c-00b43c1c07df tempest-ServersWithSpecificFlavorTestJSON-1001305181 tempest-ServersWithSpecificFlavorTestJSON-1001305181-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:35:01.150010 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-f849a0dd-acde-4e2b-b15c-00b43c1c07df tempest-ServersWithSpecificFlavorTestJSON-1001305181 tempest-ServersWithSpecificFlavorTestJSON-1001305181-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:35:22.452423 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-da0d9d54-34f2-4933-9f3b-a53543811f91 tempest-ImagesNegativeTestJSON-558316208 tempest-ImagesNegativeTestJSON-558316208-project] Took 0.52 seconds to select destinations for 1 instance(s). {{(pid=98843) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 13:35:22.492006 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-da0d9d54-34f2-4933-9f3b-a53543811f91 tempest-ImagesNegativeTestJSON-558316208 tempest-ImagesNegativeTestJSON-558316208-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:35:22.492893 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-da0d9d54-34f2-4933-9f3b-a53543811f91 tempest-ImagesNegativeTestJSON-558316208 tempest-ImagesNegativeTestJSON-558316208-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:35:22.674822 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-da0d9d54-34f2-4933-9f3b-a53543811f91 tempest-ImagesNegativeTestJSON-558316208 tempest-ImagesNegativeTestJSON-558316208-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:35:22.675616 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-da0d9d54-34f2-4933-9f3b-a53543811f91 tempest-ImagesNegativeTestJSON-558316208 tempest-ImagesNegativeTestJSON-558316208-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:35:22.678178 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-da0d9d54-34f2-4933-9f3b-a53543811f91 tempest-ImagesNegativeTestJSON-558316208 tempest-ImagesNegativeTestJSON-558316208-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:35:22.679851 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-da0d9d54-34f2-4933-9f3b-a53543811f91 tempest-ImagesNegativeTestJSON-558316208 tempest-ImagesNegativeTestJSON-558316208-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:35:22.736235 n-d-791503-6 nova-conductor[98843]: DEBUG nova.quota [None req-da0d9d54-34f2-4933-9f3b-a53543811f91 tempest-ImagesNegativeTestJSON-558316208 tempest-ImagesNegativeTestJSON-558316208-project] Getting quotas for project 3654605a75bf461cacc86d13f0402e13. Resources: {'cores', 'ram', 'instances'} {{(pid=98843) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 13:35:22.749110 n-d-791503-6 nova-conductor[98843]: DEBUG nova.quota [None req-da0d9d54-34f2-4933-9f3b-a53543811f91 tempest-ImagesNegativeTestJSON-558316208 tempest-ImagesNegativeTestJSON-558316208-project] Getting quotas for user f406f374982c400aa519167b44899c5a and project 3654605a75bf461cacc86d13f0402e13. Resources: {'cores', 'ram', 'instances'} {{(pid=98843) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 13:35:22.785302 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-da0d9d54-34f2-4933-9f3b-a53543811f91 tempest-ImagesNegativeTestJSON-558316208 tempest-ImagesNegativeTestJSON-558316208-project] [instance: cc3912c3-5006-4e18-aa0c-947a184ca726] Selected host: n-h2-791503-6; Selected node: n-h2-791503-6; Alternates: [('n-h1-791503-6', 'n-h1-791503-6')] {{(pid=98843) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 13:35:22.785706 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-da0d9d54-34f2-4933-9f3b-a53543811f91 tempest-ImagesNegativeTestJSON-558316208 tempest-ImagesNegativeTestJSON-558316208-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:35:22.786116 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-da0d9d54-34f2-4933-9f3b-a53543811f91 tempest-ImagesNegativeTestJSON-558316208 tempest-ImagesNegativeTestJSON-558316208-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:35:22.813387 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-da0d9d54-34f2-4933-9f3b-a53543811f91 tempest-ImagesNegativeTestJSON-558316208 tempest-ImagesNegativeTestJSON-558316208-project] [instance: cc3912c3-5006-4e18-aa0c-947a184ca726] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='64f6036b-99a9-40e4-8963-3cdf66964954',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98843) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 13:35:22.814581 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-da0d9d54-34f2-4933-9f3b-a53543811f91 tempest-ImagesNegativeTestJSON-558316208 tempest-ImagesNegativeTestJSON-558316208-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:35:22.815155 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-da0d9d54-34f2-4933-9f3b-a53543811f91 tempest-ImagesNegativeTestJSON-558316208 tempest-ImagesNegativeTestJSON-558316208-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:35:22.895713 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-da0d9d54-34f2-4933-9f3b-a53543811f91 tempest-ImagesNegativeTestJSON-558316208 tempest-ImagesNegativeTestJSON-558316208-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:35:22.896488 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-da0d9d54-34f2-4933-9f3b-a53543811f91 tempest-ImagesNegativeTestJSON-558316208 tempest-ImagesNegativeTestJSON-558316208-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:35:29.340160 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.manager [None req-bccbdfb7-0bfc-427e-a1e4-3cb28ea3e69e tempest-ImagesTestJSON-765179807 tempest-ImagesTestJSON-765179807-project] Took 0.71 seconds to select destinations for 1 instance(s). {{(pid=98844) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 13:35:29.404872 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-bccbdfb7-0bfc-427e-a1e4-3cb28ea3e69e tempest-ImagesTestJSON-765179807 tempest-ImagesTestJSON-765179807-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:35:29.405900 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-bccbdfb7-0bfc-427e-a1e4-3cb28ea3e69e tempest-ImagesTestJSON-765179807 tempest-ImagesTestJSON-765179807-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:35:29.475039 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-0b283a56-7fd0-4607-abed-d400a97131bc tempest-LiveMigrationTest-736720477 tempest-LiveMigrationTest-736720477-project] Took 0.72 seconds to select destinations for 1 instance(s). {{(pid=98843) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 13:35:29.484475 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-bccbdfb7-0bfc-427e-a1e4-3cb28ea3e69e tempest-ImagesTestJSON-765179807 tempest-ImagesTestJSON-765179807-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:35:29.485554 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-bccbdfb7-0bfc-427e-a1e4-3cb28ea3e69e tempest-ImagesTestJSON-765179807 tempest-ImagesTestJSON-765179807-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:35:29.487194 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-bccbdfb7-0bfc-427e-a1e4-3cb28ea3e69e tempest-ImagesTestJSON-765179807 tempest-ImagesTestJSON-765179807-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:35:29.489349 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-bccbdfb7-0bfc-427e-a1e4-3cb28ea3e69e tempest-ImagesTestJSON-765179807 tempest-ImagesTestJSON-765179807-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:35:29.524504 n-d-791503-6 nova-conductor[98844]: DEBUG nova.quota [None req-bccbdfb7-0bfc-427e-a1e4-3cb28ea3e69e tempest-ImagesTestJSON-765179807 tempest-ImagesTestJSON-765179807-project] Getting quotas for project 62ce64ceb14d46bdaf4de13da1af2438. Resources: {'cores', 'ram', 'instances'} {{(pid=98844) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 13:35:29.541814 n-d-791503-6 nova-conductor[98844]: DEBUG nova.quota [None req-bccbdfb7-0bfc-427e-a1e4-3cb28ea3e69e tempest-ImagesTestJSON-765179807 tempest-ImagesTestJSON-765179807-project] Getting quotas for user 0a75d696e8d34a7f92cadcaf341f15fa and project 62ce64ceb14d46bdaf4de13da1af2438. Resources: {'cores', 'ram', 'instances'} {{(pid=98844) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 13:35:29.567134 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.manager [None req-bccbdfb7-0bfc-427e-a1e4-3cb28ea3e69e tempest-ImagesTestJSON-765179807 tempest-ImagesTestJSON-765179807-project] [instance: 5a1a00ba-eb26-44ac-9e57-bff9d24405d1] Selected host: n-h1-791503-6; Selected node: n-h1-791503-6; Alternates: [('n-h2-791503-6', 'n-h2-791503-6')] {{(pid=98844) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 13:35:29.569019 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-bccbdfb7-0bfc-427e-a1e4-3cb28ea3e69e tempest-ImagesTestJSON-765179807 tempest-ImagesTestJSON-765179807-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:35:29.569875 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-bccbdfb7-0bfc-427e-a1e4-3cb28ea3e69e tempest-ImagesTestJSON-765179807 tempest-ImagesTestJSON-765179807-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:35:29.583038 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.manager [None req-bccbdfb7-0bfc-427e-a1e4-3cb28ea3e69e tempest-ImagesTestJSON-765179807 tempest-ImagesTestJSON-765179807-project] [instance: 5a1a00ba-eb26-44ac-9e57-bff9d24405d1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='64f6036b-99a9-40e4-8963-3cdf66964954',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98844) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 13:35:29.585797 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-bccbdfb7-0bfc-427e-a1e4-3cb28ea3e69e tempest-ImagesTestJSON-765179807 tempest-ImagesTestJSON-765179807-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:35:29.586849 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-bccbdfb7-0bfc-427e-a1e4-3cb28ea3e69e tempest-ImagesTestJSON-765179807 tempest-ImagesTestJSON-765179807-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:35:29.604429 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-0b283a56-7fd0-4607-abed-d400a97131bc tempest-LiveMigrationTest-736720477 tempest-LiveMigrationTest-736720477-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:35:29.607367 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-0b283a56-7fd0-4607-abed-d400a97131bc tempest-LiveMigrationTest-736720477 tempest-LiveMigrationTest-736720477-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:35:29.660443 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-bccbdfb7-0bfc-427e-a1e4-3cb28ea3e69e tempest-ImagesTestJSON-765179807 tempest-ImagesTestJSON-765179807-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:35:29.661924 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-bccbdfb7-0bfc-427e-a1e4-3cb28ea3e69e tempest-ImagesTestJSON-765179807 tempest-ImagesTestJSON-765179807-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:35:29.710013 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-0b283a56-7fd0-4607-abed-d400a97131bc tempest-LiveMigrationTest-736720477 tempest-LiveMigrationTest-736720477-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:35:29.710939 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-0b283a56-7fd0-4607-abed-d400a97131bc tempest-LiveMigrationTest-736720477 tempest-LiveMigrationTest-736720477-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:35:29.712751 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-0b283a56-7fd0-4607-abed-d400a97131bc tempest-LiveMigrationTest-736720477 tempest-LiveMigrationTest-736720477-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:35:29.713709 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-0b283a56-7fd0-4607-abed-d400a97131bc tempest-LiveMigrationTest-736720477 tempest-LiveMigrationTest-736720477-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:35:29.764741 n-d-791503-6 nova-conductor[98843]: DEBUG nova.quota [None req-0b283a56-7fd0-4607-abed-d400a97131bc tempest-LiveMigrationTest-736720477 tempest-LiveMigrationTest-736720477-project] Getting quotas for project 876db6c4b6fe4dfb8d8783136238669a. Resources: {'cores', 'ram', 'instances'} {{(pid=98843) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 13:35:29.790589 n-d-791503-6 nova-conductor[98843]: DEBUG nova.quota [None req-0b283a56-7fd0-4607-abed-d400a97131bc tempest-LiveMigrationTest-736720477 tempest-LiveMigrationTest-736720477-project] Getting quotas for user 26ef8efd255740368f90ec8fa053c9a3 and project 876db6c4b6fe4dfb8d8783136238669a. Resources: {'cores', 'ram', 'instances'} {{(pid=98843) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 13:35:29.859430 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-0b283a56-7fd0-4607-abed-d400a97131bc tempest-LiveMigrationTest-736720477 tempest-LiveMigrationTest-736720477-project] [instance: f4191af4-eda7-4d75-ae34-653413de9c8f] Selected host: n-h1-791503-6; Selected node: n-h1-791503-6; Alternates: [('n-h2-791503-6', 'n-h2-791503-6')] {{(pid=98843) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 13:35:29.860283 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-0b283a56-7fd0-4607-abed-d400a97131bc tempest-LiveMigrationTest-736720477 tempest-LiveMigrationTest-736720477-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:35:29.860758 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-0b283a56-7fd0-4607-abed-d400a97131bc tempest-LiveMigrationTest-736720477 tempest-LiveMigrationTest-736720477-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:35:29.882914 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-0b283a56-7fd0-4607-abed-d400a97131bc tempest-LiveMigrationTest-736720477 tempest-LiveMigrationTest-736720477-project] [instance: f4191af4-eda7-4d75-ae34-653413de9c8f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='64f6036b-99a9-40e4-8963-3cdf66964954',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98843) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 13:35:29.884254 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-0b283a56-7fd0-4607-abed-d400a97131bc tempest-LiveMigrationTest-736720477 tempest-LiveMigrationTest-736720477-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:35:29.884667 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-0b283a56-7fd0-4607-abed-d400a97131bc tempest-LiveMigrationTest-736720477 tempest-LiveMigrationTest-736720477-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:35:29.954690 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-0b283a56-7fd0-4607-abed-d400a97131bc tempest-LiveMigrationTest-736720477 tempest-LiveMigrationTest-736720477-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:35:29.955334 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-0b283a56-7fd0-4607-abed-d400a97131bc tempest-LiveMigrationTest-736720477 tempest-LiveMigrationTest-736720477-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:35:52.951772 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.manager [None req-183849bb-6da4-4510-83a7-ebed5b7a9e5b tempest-LiveAutoBlockMigrationV225Test-1459235087 tempest-LiveAutoBlockMigrationV225Test-1459235087-project-admin] Targeting cell b241212c-c279-4fbb-a1e7-b87889287cbf(cell1) for conductor method migrate_server {{(pid=98844) wrapper /opt/stack/nova/nova/conductor/manager.py:91}} May 28 13:35:52.952752 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-183849bb-6da4-4510-83a7-ebed5b7a9e5b tempest-LiveAutoBlockMigrationV225Test-1459235087 tempest-LiveAutoBlockMigrationV225Test-1459235087-project-admin] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:35:52.952752 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-183849bb-6da4-4510-83a7-ebed5b7a9e5b tempest-LiveAutoBlockMigrationV225Test-1459235087 tempest-LiveAutoBlockMigrationV225Test-1459235087-project-admin] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:35:54.287633 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.tasks.migrate [None req-183849bb-6da4-4510-83a7-ebed5b7a9e5b tempest-LiveAutoBlockMigrationV225Test-1459235087 tempest-LiveAutoBlockMigrationV225Test-1459235087-project-admin] Created allocations for migration c9bc9511-cd4f-4cd9-aff1-47a1cb7778a0 on d4341c2e-3ff0-43f5-9b7e-4ec6191a47d4 {{(pid=98844) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} May 28 13:35:54.561297 n-d-791503-6 nova-conductor[98844]: DEBUG nova.scheduler.utils [None req-183849bb-6da4-4510-83a7-ebed5b7a9e5b tempest-LiveAutoBlockMigrationV225Test-1459235087 tempest-LiveAutoBlockMigrationV225Test-1459235087-project-admin] [instance: 1e577ff8-dc8c-4f42-93c8-5bd54c39d082] Instance allocations successfully created on destination node 5c5ac110-743a-4b71-a058-d2597ba8e0c9: {'allocations': {'5c5ac110-743a-4b71-a058-d2597ba8e0c9': {'resources': {'VCPU': 1, 'MEMORY_MB': 1024, 'DISK_GB': 1}}}} {{(pid=98844) claim_resources_on_destination /opt/stack/nova/nova/scheduler/utils.py:827}} May 28 13:35:54.562538 n-d-791503-6 nova-conductor[98844]: DEBUG nova.objects.instance [None req-183849bb-6da4-4510-83a7-ebed5b7a9e5b tempest-LiveAutoBlockMigrationV225Test-1459235087 tempest-LiveAutoBlockMigrationV225Test-1459235087-project-admin] Lazy-loading 'resources' on Instance uuid 1e577ff8-dc8c-4f42-93c8-5bd54c39d082 {{(pid=98844) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 28 13:35:54.572551 n-d-791503-6 nova-conductor[98844]: DEBUG nova.objects.instance [None req-183849bb-6da4-4510-83a7-ebed5b7a9e5b tempest-LiveAutoBlockMigrationV225Test-1459235087 tempest-LiveAutoBlockMigrationV225Test-1459235087-project-admin] Lazy-loading 'pci_requests' on Instance uuid 1e577ff8-dc8c-4f42-93c8-5bd54c39d082 {{(pid=98844) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 28 13:35:55.125454 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.tasks.live_migrate [None req-183849bb-6da4-4510-83a7-ebed5b7a9e5b tempest-LiveAutoBlockMigrationV225Test-1459235087 tempest-LiveAutoBlockMigrationV225Test-1459235087-project-admin] [instance: 1e577ff8-dc8c-4f42-93c8-5bd54c39d082] Start binding ports on destination host: n-h2-791503-6 {{(pid=98844) _bind_ports_on_destination /opt/stack/nova/nova/conductor/tasks/live_migrate.py:389}} May 28 13:36:01.207244 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-80a33238-6ab2-447f-ba56-43135e162534 tempest-ServersTestMultiNic-1021902988 tempest-ServersTestMultiNic-1021902988-project] Took 0.78 seconds to select destinations for 1 instance(s). {{(pid=98843) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 13:36:01.295694 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-80a33238-6ab2-447f-ba56-43135e162534 tempest-ServersTestMultiNic-1021902988 tempest-ServersTestMultiNic-1021902988-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:36:01.296383 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-80a33238-6ab2-447f-ba56-43135e162534 tempest-ServersTestMultiNic-1021902988 tempest-ServersTestMultiNic-1021902988-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:36:01.467369 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-80a33238-6ab2-447f-ba56-43135e162534 tempest-ServersTestMultiNic-1021902988 tempest-ServersTestMultiNic-1021902988-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:36:01.468053 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-80a33238-6ab2-447f-ba56-43135e162534 tempest-ServersTestMultiNic-1021902988 tempest-ServersTestMultiNic-1021902988-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:36:01.469305 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-80a33238-6ab2-447f-ba56-43135e162534 tempest-ServersTestMultiNic-1021902988 tempest-ServersTestMultiNic-1021902988-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:36:01.469942 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-80a33238-6ab2-447f-ba56-43135e162534 tempest-ServersTestMultiNic-1021902988 tempest-ServersTestMultiNic-1021902988-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:36:01.548276 n-d-791503-6 nova-conductor[98843]: DEBUG nova.quota [None req-80a33238-6ab2-447f-ba56-43135e162534 tempest-ServersTestMultiNic-1021902988 tempest-ServersTestMultiNic-1021902988-project] Getting quotas for project 3bededc5d3824029ab8afc68746aa588. Resources: {'cores', 'ram', 'instances'} {{(pid=98843) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 13:36:01.565998 n-d-791503-6 nova-conductor[98843]: DEBUG nova.quota [None req-80a33238-6ab2-447f-ba56-43135e162534 tempest-ServersTestMultiNic-1021902988 tempest-ServersTestMultiNic-1021902988-project] Getting quotas for user 50634b1ef3174a22a50a15aed2a6a009 and project 3bededc5d3824029ab8afc68746aa588. Resources: {'cores', 'ram', 'instances'} {{(pid=98843) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 13:36:01.601869 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-80a33238-6ab2-447f-ba56-43135e162534 tempest-ServersTestMultiNic-1021902988 tempest-ServersTestMultiNic-1021902988-project] [instance: d534be6d-5121-4287-974e-1321861ff02f] Selected host: n-h2-791503-6; Selected node: n-h2-791503-6; Alternates: [('n-h1-791503-6', 'n-h1-791503-6')] {{(pid=98843) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 13:36:01.602863 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-80a33238-6ab2-447f-ba56-43135e162534 tempest-ServersTestMultiNic-1021902988 tempest-ServersTestMultiNic-1021902988-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:36:01.603290 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-80a33238-6ab2-447f-ba56-43135e162534 tempest-ServersTestMultiNic-1021902988 tempest-ServersTestMultiNic-1021902988-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:36:01.622856 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-80a33238-6ab2-447f-ba56-43135e162534 tempest-ServersTestMultiNic-1021902988 tempest-ServersTestMultiNic-1021902988-project] [instance: d534be6d-5121-4287-974e-1321861ff02f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='64f6036b-99a9-40e4-8963-3cdf66964954',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98843) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 13:36:01.624173 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-80a33238-6ab2-447f-ba56-43135e162534 tempest-ServersTestMultiNic-1021902988 tempest-ServersTestMultiNic-1021902988-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:36:01.624591 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-80a33238-6ab2-447f-ba56-43135e162534 tempest-ServersTestMultiNic-1021902988 tempest-ServersTestMultiNic-1021902988-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:36:01.695857 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-80a33238-6ab2-447f-ba56-43135e162534 tempest-ServersTestMultiNic-1021902988 tempest-ServersTestMultiNic-1021902988-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:36:01.696290 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-80a33238-6ab2-447f-ba56-43135e162534 tempest-ServersTestMultiNic-1021902988 tempest-ServersTestMultiNic-1021902988-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:36:23.122473 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.manager [None req-cb9726bc-b195-438a-b119-f04aa53835c2 tempest-InstanceActionsNegativeTestJSON-1766130863 tempest-InstanceActionsNegativeTestJSON-1766130863-project] Took 0.54 seconds to select destinations for 1 instance(s). {{(pid=98844) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 13:36:23.180129 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-cb9726bc-b195-438a-b119-f04aa53835c2 tempest-InstanceActionsNegativeTestJSON-1766130863 tempest-InstanceActionsNegativeTestJSON-1766130863-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:36:23.180577 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-cb9726bc-b195-438a-b119-f04aa53835c2 tempest-InstanceActionsNegativeTestJSON-1766130863 tempest-InstanceActionsNegativeTestJSON-1766130863-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:36:23.262003 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-cb9726bc-b195-438a-b119-f04aa53835c2 tempest-InstanceActionsNegativeTestJSON-1766130863 tempest-InstanceActionsNegativeTestJSON-1766130863-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:36:23.263353 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-cb9726bc-b195-438a-b119-f04aa53835c2 tempest-InstanceActionsNegativeTestJSON-1766130863 tempest-InstanceActionsNegativeTestJSON-1766130863-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:36:23.264326 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-cb9726bc-b195-438a-b119-f04aa53835c2 tempest-InstanceActionsNegativeTestJSON-1766130863 tempest-InstanceActionsNegativeTestJSON-1766130863-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:36:23.264936 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-cb9726bc-b195-438a-b119-f04aa53835c2 tempest-InstanceActionsNegativeTestJSON-1766130863 tempest-InstanceActionsNegativeTestJSON-1766130863-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:36:23.289711 n-d-791503-6 nova-conductor[98844]: DEBUG nova.quota [None req-cb9726bc-b195-438a-b119-f04aa53835c2 tempest-InstanceActionsNegativeTestJSON-1766130863 tempest-InstanceActionsNegativeTestJSON-1766130863-project] Getting quotas for project 2596a30cf35f4b82abf2cb048a685ae7. Resources: {'cores', 'ram', 'instances'} {{(pid=98844) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 13:36:23.296116 n-d-791503-6 nova-conductor[98844]: DEBUG nova.quota [None req-cb9726bc-b195-438a-b119-f04aa53835c2 tempest-InstanceActionsNegativeTestJSON-1766130863 tempest-InstanceActionsNegativeTestJSON-1766130863-project] Getting quotas for user 59195815de954b45900cfebbc370398c and project 2596a30cf35f4b82abf2cb048a685ae7. Resources: {'cores', 'ram', 'instances'} {{(pid=98844) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 13:36:23.310402 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.manager [None req-cb9726bc-b195-438a-b119-f04aa53835c2 tempest-InstanceActionsNegativeTestJSON-1766130863 tempest-InstanceActionsNegativeTestJSON-1766130863-project] [instance: 6a0e5cea-f807-4e15-aac1-1d95c967cee3] Selected host: n-h2-791503-6; Selected node: n-h2-791503-6; Alternates: [('n-h1-791503-6', 'n-h1-791503-6')] {{(pid=98844) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 13:36:23.311402 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-cb9726bc-b195-438a-b119-f04aa53835c2 tempest-InstanceActionsNegativeTestJSON-1766130863 tempest-InstanceActionsNegativeTestJSON-1766130863-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:36:23.311831 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-cb9726bc-b195-438a-b119-f04aa53835c2 tempest-InstanceActionsNegativeTestJSON-1766130863 tempest-InstanceActionsNegativeTestJSON-1766130863-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:36:23.321600 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.manager [None req-cb9726bc-b195-438a-b119-f04aa53835c2 tempest-InstanceActionsNegativeTestJSON-1766130863 tempest-InstanceActionsNegativeTestJSON-1766130863-project] [instance: 6a0e5cea-f807-4e15-aac1-1d95c967cee3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='64f6036b-99a9-40e4-8963-3cdf66964954',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98844) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 13:36:23.323632 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-cb9726bc-b195-438a-b119-f04aa53835c2 tempest-InstanceActionsNegativeTestJSON-1766130863 tempest-InstanceActionsNegativeTestJSON-1766130863-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:36:23.324340 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-cb9726bc-b195-438a-b119-f04aa53835c2 tempest-InstanceActionsNegativeTestJSON-1766130863 tempest-InstanceActionsNegativeTestJSON-1766130863-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:36:23.369510 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-cb9726bc-b195-438a-b119-f04aa53835c2 tempest-InstanceActionsNegativeTestJSON-1766130863 tempest-InstanceActionsNegativeTestJSON-1766130863-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:36:23.370198 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-cb9726bc-b195-438a-b119-f04aa53835c2 tempest-InstanceActionsNegativeTestJSON-1766130863 tempest-InstanceActionsNegativeTestJSON-1766130863-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:36:36.573002 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-37d661ac-0892-4e26-9ad4-ad4502803aaf tempest-LiveMigrationTest-384423165 tempest-LiveMigrationTest-384423165-project-admin] Targeting cell b241212c-c279-4fbb-a1e7-b87889287cbf(cell1) for conductor method migrate_server {{(pid=98843) wrapper /opt/stack/nova/nova/conductor/manager.py:91}} May 28 13:36:36.574107 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-37d661ac-0892-4e26-9ad4-ad4502803aaf tempest-LiveMigrationTest-384423165 tempest-LiveMigrationTest-384423165-project-admin] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:36:36.579722 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-37d661ac-0892-4e26-9ad4-ad4502803aaf tempest-LiveMigrationTest-384423165 tempest-LiveMigrationTest-384423165-project-admin] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:36:38.265073 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.tasks.migrate [None req-37d661ac-0892-4e26-9ad4-ad4502803aaf tempest-LiveMigrationTest-384423165 tempest-LiveMigrationTest-384423165-project-admin] Created allocations for migration 59aef6ba-ae92-493d-ab70-07e14a0a3d19 on d4341c2e-3ff0-43f5-9b7e-4ec6191a47d4 {{(pid=98843) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} May 28 13:36:38.586211 n-d-791503-6 nova-conductor[98843]: DEBUG nova.scheduler.utils [None req-37d661ac-0892-4e26-9ad4-ad4502803aaf tempest-LiveMigrationTest-384423165 tempest-LiveMigrationTest-384423165-project-admin] [instance: f4191af4-eda7-4d75-ae34-653413de9c8f] Instance allocations successfully created on destination node 5c5ac110-743a-4b71-a058-d2597ba8e0c9: {'allocations': {'5c5ac110-743a-4b71-a058-d2597ba8e0c9': {'resources': {'VCPU': 1, 'MEMORY_MB': 1024, 'DISK_GB': 1}}}} {{(pid=98843) claim_resources_on_destination /opt/stack/nova/nova/scheduler/utils.py:827}} May 28 13:36:38.587005 n-d-791503-6 nova-conductor[98843]: DEBUG nova.objects.instance [None req-37d661ac-0892-4e26-9ad4-ad4502803aaf tempest-LiveMigrationTest-384423165 tempest-LiveMigrationTest-384423165-project-admin] Lazy-loading 'resources' on Instance uuid f4191af4-eda7-4d75-ae34-653413de9c8f {{(pid=98843) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 28 13:36:38.614566 n-d-791503-6 nova-conductor[98843]: DEBUG nova.objects.instance [None req-37d661ac-0892-4e26-9ad4-ad4502803aaf tempest-LiveMigrationTest-384423165 tempest-LiveMigrationTest-384423165-project-admin] Lazy-loading 'pci_requests' on Instance uuid f4191af4-eda7-4d75-ae34-653413de9c8f {{(pid=98843) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 28 13:36:39.351518 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.tasks.live_migrate [None req-37d661ac-0892-4e26-9ad4-ad4502803aaf tempest-LiveMigrationTest-384423165 tempest-LiveMigrationTest-384423165-project-admin] [instance: f4191af4-eda7-4d75-ae34-653413de9c8f] Start binding ports on destination host: n-h2-791503-6 {{(pid=98843) _bind_ports_on_destination /opt/stack/nova/nova/conductor/tasks/live_migrate.py:389}} May 28 13:36:49.476755 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.manager [None req-b0c49244-43f5-4f9f-9736-929cb07d2047 tempest-ImagesOneServerNegativeTestJSON-1003266287 tempest-ImagesOneServerNegativeTestJSON-1003266287-project] Took 0.64 seconds to select destinations for 1 instance(s). {{(pid=98844) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 13:36:49.561299 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-b0c49244-43f5-4f9f-9736-929cb07d2047 tempest-ImagesOneServerNegativeTestJSON-1003266287 tempest-ImagesOneServerNegativeTestJSON-1003266287-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:36:49.562464 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-b0c49244-43f5-4f9f-9736-929cb07d2047 tempest-ImagesOneServerNegativeTestJSON-1003266287 tempest-ImagesOneServerNegativeTestJSON-1003266287-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:36:49.772176 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-b0c49244-43f5-4f9f-9736-929cb07d2047 tempest-ImagesOneServerNegativeTestJSON-1003266287 tempest-ImagesOneServerNegativeTestJSON-1003266287-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:36:49.772578 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-b0c49244-43f5-4f9f-9736-929cb07d2047 tempest-ImagesOneServerNegativeTestJSON-1003266287 tempest-ImagesOneServerNegativeTestJSON-1003266287-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:36:49.777466 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-b0c49244-43f5-4f9f-9736-929cb07d2047 tempest-ImagesOneServerNegativeTestJSON-1003266287 tempest-ImagesOneServerNegativeTestJSON-1003266287-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:36:49.778131 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-b0c49244-43f5-4f9f-9736-929cb07d2047 tempest-ImagesOneServerNegativeTestJSON-1003266287 tempest-ImagesOneServerNegativeTestJSON-1003266287-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:36:49.829391 n-d-791503-6 nova-conductor[98844]: DEBUG nova.quota [None req-b0c49244-43f5-4f9f-9736-929cb07d2047 tempest-ImagesOneServerNegativeTestJSON-1003266287 tempest-ImagesOneServerNegativeTestJSON-1003266287-project] Getting quotas for project c12f99538c984b508484f7d7b64f4827. Resources: {'cores', 'ram', 'instances'} {{(pid=98844) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 13:36:49.853154 n-d-791503-6 nova-conductor[98844]: DEBUG nova.quota [None req-b0c49244-43f5-4f9f-9736-929cb07d2047 tempest-ImagesOneServerNegativeTestJSON-1003266287 tempest-ImagesOneServerNegativeTestJSON-1003266287-project] Getting quotas for user 1e15c7ce91e84f00977a299ac05ae5b0 and project c12f99538c984b508484f7d7b64f4827. Resources: {'cores', 'ram', 'instances'} {{(pid=98844) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 13:36:49.892360 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.manager [None req-b0c49244-43f5-4f9f-9736-929cb07d2047 tempest-ImagesOneServerNegativeTestJSON-1003266287 tempest-ImagesOneServerNegativeTestJSON-1003266287-project] [instance: 7e7136cb-71aa-4fd6-a863-f79fc2a0c164] Selected host: n-h1-791503-6; Selected node: n-h1-791503-6; Alternates: [('n-h2-791503-6', 'n-h2-791503-6')] {{(pid=98844) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 13:36:49.893546 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-b0c49244-43f5-4f9f-9736-929cb07d2047 tempest-ImagesOneServerNegativeTestJSON-1003266287 tempest-ImagesOneServerNegativeTestJSON-1003266287-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:36:49.893961 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-b0c49244-43f5-4f9f-9736-929cb07d2047 tempest-ImagesOneServerNegativeTestJSON-1003266287 tempest-ImagesOneServerNegativeTestJSON-1003266287-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:36:49.915925 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.manager [None req-b0c49244-43f5-4f9f-9736-929cb07d2047 tempest-ImagesOneServerNegativeTestJSON-1003266287 tempest-ImagesOneServerNegativeTestJSON-1003266287-project] [instance: 7e7136cb-71aa-4fd6-a863-f79fc2a0c164] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='64f6036b-99a9-40e4-8963-3cdf66964954',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98844) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 13:36:49.919121 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-b0c49244-43f5-4f9f-9736-929cb07d2047 tempest-ImagesOneServerNegativeTestJSON-1003266287 tempest-ImagesOneServerNegativeTestJSON-1003266287-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:36:49.919528 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-b0c49244-43f5-4f9f-9736-929cb07d2047 tempest-ImagesOneServerNegativeTestJSON-1003266287 tempest-ImagesOneServerNegativeTestJSON-1003266287-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:36:49.995263 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-b0c49244-43f5-4f9f-9736-929cb07d2047 tempest-ImagesOneServerNegativeTestJSON-1003266287 tempest-ImagesOneServerNegativeTestJSON-1003266287-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:36:49.995884 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-b0c49244-43f5-4f9f-9736-929cb07d2047 tempest-ImagesOneServerNegativeTestJSON-1003266287 tempest-ImagesOneServerNegativeTestJSON-1003266287-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:37:10.263029 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-d97e97f9-d8e9-4004-b7bc-9b6f3c252d72 tempest-ImagesTestJSON-765179807 tempest-ImagesTestJSON-765179807-project] Took 0.50 seconds to select destinations for 1 instance(s). {{(pid=98843) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 13:37:10.343154 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-d97e97f9-d8e9-4004-b7bc-9b6f3c252d72 tempest-ImagesTestJSON-765179807 tempest-ImagesTestJSON-765179807-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:37:10.344292 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-d97e97f9-d8e9-4004-b7bc-9b6f3c252d72 tempest-ImagesTestJSON-765179807 tempest-ImagesTestJSON-765179807-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:37:10.461499 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-d97e97f9-d8e9-4004-b7bc-9b6f3c252d72 tempest-ImagesTestJSON-765179807 tempest-ImagesTestJSON-765179807-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:37:10.462306 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-d97e97f9-d8e9-4004-b7bc-9b6f3c252d72 tempest-ImagesTestJSON-765179807 tempest-ImagesTestJSON-765179807-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:37:10.467525 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-d97e97f9-d8e9-4004-b7bc-9b6f3c252d72 tempest-ImagesTestJSON-765179807 tempest-ImagesTestJSON-765179807-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:37:10.481903 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-d97e97f9-d8e9-4004-b7bc-9b6f3c252d72 tempest-ImagesTestJSON-765179807 tempest-ImagesTestJSON-765179807-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:37:10.553092 n-d-791503-6 nova-conductor[98843]: DEBUG nova.quota [None req-d97e97f9-d8e9-4004-b7bc-9b6f3c252d72 tempest-ImagesTestJSON-765179807 tempest-ImagesTestJSON-765179807-project] Getting quotas for project 62ce64ceb14d46bdaf4de13da1af2438. Resources: {'cores', 'ram', 'instances'} {{(pid=98843) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 13:37:10.571540 n-d-791503-6 nova-conductor[98843]: DEBUG nova.quota [None req-d97e97f9-d8e9-4004-b7bc-9b6f3c252d72 tempest-ImagesTestJSON-765179807 tempest-ImagesTestJSON-765179807-project] Getting quotas for user 0a75d696e8d34a7f92cadcaf341f15fa and project 62ce64ceb14d46bdaf4de13da1af2438. Resources: {'cores', 'ram', 'instances'} {{(pid=98843) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 13:37:10.617352 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-d97e97f9-d8e9-4004-b7bc-9b6f3c252d72 tempest-ImagesTestJSON-765179807 tempest-ImagesTestJSON-765179807-project] [instance: b0c0d79f-2c3d-47e4-8378-977776b86d47] Selected host: n-h2-791503-6; Selected node: n-h2-791503-6; Alternates: [('n-h1-791503-6', 'n-h1-791503-6')] {{(pid=98843) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 13:37:10.619088 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-d97e97f9-d8e9-4004-b7bc-9b6f3c252d72 tempest-ImagesTestJSON-765179807 tempest-ImagesTestJSON-765179807-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:37:10.622568 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-d97e97f9-d8e9-4004-b7bc-9b6f3c252d72 tempest-ImagesTestJSON-765179807 tempest-ImagesTestJSON-765179807-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:37:10.646437 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-d97e97f9-d8e9-4004-b7bc-9b6f3c252d72 tempest-ImagesTestJSON-765179807 tempest-ImagesTestJSON-765179807-project] [instance: b0c0d79f-2c3d-47e4-8378-977776b86d47] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='64f6036b-99a9-40e4-8963-3cdf66964954',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98843) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 13:37:10.648912 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-d97e97f9-d8e9-4004-b7bc-9b6f3c252d72 tempest-ImagesTestJSON-765179807 tempest-ImagesTestJSON-765179807-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:37:10.649482 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-d97e97f9-d8e9-4004-b7bc-9b6f3c252d72 tempest-ImagesTestJSON-765179807 tempest-ImagesTestJSON-765179807-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:37:10.737626 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-d97e97f9-d8e9-4004-b7bc-9b6f3c252d72 tempest-ImagesTestJSON-765179807 tempest-ImagesTestJSON-765179807-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:37:10.738291 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-d97e97f9-d8e9-4004-b7bc-9b6f3c252d72 tempest-ImagesTestJSON-765179807 tempest-ImagesTestJSON-765179807-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:37:26.177639 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.manager [None req-81b11b98-ee2c-4435-bcc1-b0342e56cb96 tempest-ListServerFiltersTestJSON-1846929961 tempest-ListServerFiltersTestJSON-1846929961-project] Took 0.84 seconds to select destinations for 1 instance(s). {{(pid=98844) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 13:37:26.234611 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-81b11b98-ee2c-4435-bcc1-b0342e56cb96 tempest-ListServerFiltersTestJSON-1846929961 tempest-ListServerFiltersTestJSON-1846929961-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:37:26.237360 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-81b11b98-ee2c-4435-bcc1-b0342e56cb96 tempest-ListServerFiltersTestJSON-1846929961 tempest-ListServerFiltersTestJSON-1846929961-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:37:26.383224 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-81b11b98-ee2c-4435-bcc1-b0342e56cb96 tempest-ListServerFiltersTestJSON-1846929961 tempest-ListServerFiltersTestJSON-1846929961-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:37:26.384255 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-81b11b98-ee2c-4435-bcc1-b0342e56cb96 tempest-ListServerFiltersTestJSON-1846929961 tempest-ListServerFiltersTestJSON-1846929961-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:37:26.385547 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-81b11b98-ee2c-4435-bcc1-b0342e56cb96 tempest-ListServerFiltersTestJSON-1846929961 tempest-ListServerFiltersTestJSON-1846929961-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:37:26.386331 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-81b11b98-ee2c-4435-bcc1-b0342e56cb96 tempest-ListServerFiltersTestJSON-1846929961 tempest-ListServerFiltersTestJSON-1846929961-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:37:26.443706 n-d-791503-6 nova-conductor[98844]: DEBUG nova.quota [None req-81b11b98-ee2c-4435-bcc1-b0342e56cb96 tempest-ListServerFiltersTestJSON-1846929961 tempest-ListServerFiltersTestJSON-1846929961-project] Getting quotas for project f192e1538d3a4c0e89ac7d171bb7da01. Resources: {'cores', 'ram', 'instances'} {{(pid=98844) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 13:37:26.471979 n-d-791503-6 nova-conductor[98844]: DEBUG nova.quota [None req-81b11b98-ee2c-4435-bcc1-b0342e56cb96 tempest-ListServerFiltersTestJSON-1846929961 tempest-ListServerFiltersTestJSON-1846929961-project] Getting quotas for user 33c06ec894a84405b8d7e3f1890f603f and project f192e1538d3a4c0e89ac7d171bb7da01. Resources: {'cores', 'ram', 'instances'} {{(pid=98844) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 13:37:26.528922 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.manager [None req-81b11b98-ee2c-4435-bcc1-b0342e56cb96 tempest-ListServerFiltersTestJSON-1846929961 tempest-ListServerFiltersTestJSON-1846929961-project] [instance: a540dc28-db70-40e5-add2-ada0535251f9] Selected host: n-h2-791503-6; Selected node: n-h2-791503-6; Alternates: [('n-h1-791503-6', 'n-h1-791503-6')] {{(pid=98844) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 13:37:26.530581 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-81b11b98-ee2c-4435-bcc1-b0342e56cb96 tempest-ListServerFiltersTestJSON-1846929961 tempest-ListServerFiltersTestJSON-1846929961-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:37:26.540690 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-81b11b98-ee2c-4435-bcc1-b0342e56cb96 tempest-ListServerFiltersTestJSON-1846929961 tempest-ListServerFiltersTestJSON-1846929961-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:37:26.562756 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.manager [None req-81b11b98-ee2c-4435-bcc1-b0342e56cb96 tempest-ListServerFiltersTestJSON-1846929961 tempest-ListServerFiltersTestJSON-1846929961-project] [instance: a540dc28-db70-40e5-add2-ada0535251f9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='64f6036b-99a9-40e4-8963-3cdf66964954',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98844) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 13:37:26.565081 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-81b11b98-ee2c-4435-bcc1-b0342e56cb96 tempest-ListServerFiltersTestJSON-1846929961 tempest-ListServerFiltersTestJSON-1846929961-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:37:26.565752 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-81b11b98-ee2c-4435-bcc1-b0342e56cb96 tempest-ListServerFiltersTestJSON-1846929961 tempest-ListServerFiltersTestJSON-1846929961-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:37:26.673760 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-81b11b98-ee2c-4435-bcc1-b0342e56cb96 tempest-ListServerFiltersTestJSON-1846929961 tempest-ListServerFiltersTestJSON-1846929961-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:37:26.675043 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-81b11b98-ee2c-4435-bcc1-b0342e56cb96 tempest-ListServerFiltersTestJSON-1846929961 tempest-ListServerFiltersTestJSON-1846929961-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:37:33.333635 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-8a0a254e-0d7e-4f72-8039-fadc9ef6e59b tempest-ListServerFiltersTestJSON-1846929961 tempest-ListServerFiltersTestJSON-1846929961-project] Took 0.70 seconds to select destinations for 1 instance(s). {{(pid=98843) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 13:37:33.416115 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-8a0a254e-0d7e-4f72-8039-fadc9ef6e59b tempest-ListServerFiltersTestJSON-1846929961 tempest-ListServerFiltersTestJSON-1846929961-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:37:33.418007 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-8a0a254e-0d7e-4f72-8039-fadc9ef6e59b tempest-ListServerFiltersTestJSON-1846929961 tempest-ListServerFiltersTestJSON-1846929961-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:37:33.456401 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.manager [None req-d52b9f47-88a7-4508-9400-3b522aa0a46a tempest-FloatingIPsAssociationTestJSON-678246677 tempest-FloatingIPsAssociationTestJSON-678246677-project] Took 0.75 seconds to select destinations for 1 instance(s). {{(pid=98844) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 13:37:33.539519 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-d52b9f47-88a7-4508-9400-3b522aa0a46a tempest-FloatingIPsAssociationTestJSON-678246677 tempest-FloatingIPsAssociationTestJSON-678246677-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:37:33.540177 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-d52b9f47-88a7-4508-9400-3b522aa0a46a tempest-FloatingIPsAssociationTestJSON-678246677 tempest-FloatingIPsAssociationTestJSON-678246677-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:37:33.573008 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-8a0a254e-0d7e-4f72-8039-fadc9ef6e59b tempest-ListServerFiltersTestJSON-1846929961 tempest-ListServerFiltersTestJSON-1846929961-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:37:33.573866 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-8a0a254e-0d7e-4f72-8039-fadc9ef6e59b tempest-ListServerFiltersTestJSON-1846929961 tempest-ListServerFiltersTestJSON-1846929961-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:37:33.575952 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-8a0a254e-0d7e-4f72-8039-fadc9ef6e59b tempest-ListServerFiltersTestJSON-1846929961 tempest-ListServerFiltersTestJSON-1846929961-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:37:33.576669 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-8a0a254e-0d7e-4f72-8039-fadc9ef6e59b tempest-ListServerFiltersTestJSON-1846929961 tempest-ListServerFiltersTestJSON-1846929961-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:37:33.645001 n-d-791503-6 nova-conductor[98843]: DEBUG nova.quota [None req-8a0a254e-0d7e-4f72-8039-fadc9ef6e59b tempest-ListServerFiltersTestJSON-1846929961 tempest-ListServerFiltersTestJSON-1846929961-project] Getting quotas for project f192e1538d3a4c0e89ac7d171bb7da01. Resources: {'cores', 'ram', 'instances'} {{(pid=98843) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 13:37:33.663494 n-d-791503-6 nova-conductor[98843]: DEBUG nova.quota [None req-8a0a254e-0d7e-4f72-8039-fadc9ef6e59b tempest-ListServerFiltersTestJSON-1846929961 tempest-ListServerFiltersTestJSON-1846929961-project] Getting quotas for user 33c06ec894a84405b8d7e3f1890f603f and project f192e1538d3a4c0e89ac7d171bb7da01. Resources: {'cores', 'ram', 'instances'} {{(pid=98843) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 13:37:33.700054 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-d52b9f47-88a7-4508-9400-3b522aa0a46a tempest-FloatingIPsAssociationTestJSON-678246677 tempest-FloatingIPsAssociationTestJSON-678246677-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:37:33.700715 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-8a0a254e-0d7e-4f72-8039-fadc9ef6e59b tempest-ListServerFiltersTestJSON-1846929961 tempest-ListServerFiltersTestJSON-1846929961-project] [instance: 1624ce11-01bb-4287-b7de-5a978550401a] Selected host: n-h1-791503-6; Selected node: n-h1-791503-6; Alternates: [('n-h2-791503-6', 'n-h2-791503-6')] {{(pid=98843) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 13:37:33.700876 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-d52b9f47-88a7-4508-9400-3b522aa0a46a tempest-FloatingIPsAssociationTestJSON-678246677 tempest-FloatingIPsAssociationTestJSON-678246677-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:37:33.701974 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-d52b9f47-88a7-4508-9400-3b522aa0a46a tempest-FloatingIPsAssociationTestJSON-678246677 tempest-FloatingIPsAssociationTestJSON-678246677-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:37:33.702625 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-d52b9f47-88a7-4508-9400-3b522aa0a46a tempest-FloatingIPsAssociationTestJSON-678246677 tempest-FloatingIPsAssociationTestJSON-678246677-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:37:33.722980 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-8a0a254e-0d7e-4f72-8039-fadc9ef6e59b tempest-ListServerFiltersTestJSON-1846929961 tempest-ListServerFiltersTestJSON-1846929961-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:37:33.724094 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-8a0a254e-0d7e-4f72-8039-fadc9ef6e59b tempest-ListServerFiltersTestJSON-1846929961 tempest-ListServerFiltersTestJSON-1846929961-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:37:33.742917 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-8a0a254e-0d7e-4f72-8039-fadc9ef6e59b tempest-ListServerFiltersTestJSON-1846929961 tempest-ListServerFiltersTestJSON-1846929961-project] [instance: 1624ce11-01bb-4287-b7de-5a978550401a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='64f6036b-99a9-40e4-8963-3cdf66964954',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98843) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 13:37:33.745787 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-8a0a254e-0d7e-4f72-8039-fadc9ef6e59b tempest-ListServerFiltersTestJSON-1846929961 tempest-ListServerFiltersTestJSON-1846929961-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:37:33.746768 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-8a0a254e-0d7e-4f72-8039-fadc9ef6e59b tempest-ListServerFiltersTestJSON-1846929961 tempest-ListServerFiltersTestJSON-1846929961-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:37:33.792674 n-d-791503-6 nova-conductor[98844]: DEBUG nova.quota [None req-d52b9f47-88a7-4508-9400-3b522aa0a46a tempest-FloatingIPsAssociationTestJSON-678246677 tempest-FloatingIPsAssociationTestJSON-678246677-project] Getting quotas for project 517ebbf183e8416bb2e4778674a16961. Resources: {'cores', 'ram', 'instances'} {{(pid=98844) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 13:37:33.811839 n-d-791503-6 nova-conductor[98844]: DEBUG nova.quota [None req-d52b9f47-88a7-4508-9400-3b522aa0a46a tempest-FloatingIPsAssociationTestJSON-678246677 tempest-FloatingIPsAssociationTestJSON-678246677-project] Getting quotas for user 465a0386f9cc4c1994ae8877dd8c461b and project 517ebbf183e8416bb2e4778674a16961. Resources: {'cores', 'ram', 'instances'} {{(pid=98844) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 13:37:33.848331 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-8a0a254e-0d7e-4f72-8039-fadc9ef6e59b tempest-ListServerFiltersTestJSON-1846929961 tempest-ListServerFiltersTestJSON-1846929961-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:37:33.849002 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-8a0a254e-0d7e-4f72-8039-fadc9ef6e59b tempest-ListServerFiltersTestJSON-1846929961 tempest-ListServerFiltersTestJSON-1846929961-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:37:33.897028 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.manager [None req-d52b9f47-88a7-4508-9400-3b522aa0a46a tempest-FloatingIPsAssociationTestJSON-678246677 tempest-FloatingIPsAssociationTestJSON-678246677-project] [instance: a819bc02-a836-4978-9713-827810132f9d] Selected host: n-h1-791503-6; Selected node: n-h1-791503-6; Alternates: [('n-h2-791503-6', 'n-h2-791503-6')] {{(pid=98844) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 13:37:33.898763 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-d52b9f47-88a7-4508-9400-3b522aa0a46a tempest-FloatingIPsAssociationTestJSON-678246677 tempest-FloatingIPsAssociationTestJSON-678246677-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:37:33.919722 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-d52b9f47-88a7-4508-9400-3b522aa0a46a tempest-FloatingIPsAssociationTestJSON-678246677 tempest-FloatingIPsAssociationTestJSON-678246677-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:37:33.939983 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.manager [None req-d52b9f47-88a7-4508-9400-3b522aa0a46a tempest-FloatingIPsAssociationTestJSON-678246677 tempest-FloatingIPsAssociationTestJSON-678246677-project] [instance: a819bc02-a836-4978-9713-827810132f9d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='64f6036b-99a9-40e4-8963-3cdf66964954',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98844) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 13:37:33.942392 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-d52b9f47-88a7-4508-9400-3b522aa0a46a tempest-FloatingIPsAssociationTestJSON-678246677 tempest-FloatingIPsAssociationTestJSON-678246677-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:37:33.943084 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-d52b9f47-88a7-4508-9400-3b522aa0a46a tempest-FloatingIPsAssociationTestJSON-678246677 tempest-FloatingIPsAssociationTestJSON-678246677-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:37:34.061189 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-d52b9f47-88a7-4508-9400-3b522aa0a46a tempest-FloatingIPsAssociationTestJSON-678246677 tempest-FloatingIPsAssociationTestJSON-678246677-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:37:34.061835 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-d52b9f47-88a7-4508-9400-3b522aa0a46a tempest-FloatingIPsAssociationTestJSON-678246677 tempest-FloatingIPsAssociationTestJSON-678246677-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:37:38.762616 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-bc7846ce-baae-42c4-a339-427586caa6c9 tempest-ListServerFiltersTestJSON-1846929961 tempest-ListServerFiltersTestJSON-1846929961-project] Took 0.52 seconds to select destinations for 1 instance(s). {{(pid=98843) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 13:37:38.812522 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-bc7846ce-baae-42c4-a339-427586caa6c9 tempest-ListServerFiltersTestJSON-1846929961 tempest-ListServerFiltersTestJSON-1846929961-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:37:38.813498 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-bc7846ce-baae-42c4-a339-427586caa6c9 tempest-ListServerFiltersTestJSON-1846929961 tempest-ListServerFiltersTestJSON-1846929961-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:37:38.897638 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-bc7846ce-baae-42c4-a339-427586caa6c9 tempest-ListServerFiltersTestJSON-1846929961 tempest-ListServerFiltersTestJSON-1846929961-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:37:38.898750 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-bc7846ce-baae-42c4-a339-427586caa6c9 tempest-ListServerFiltersTestJSON-1846929961 tempest-ListServerFiltersTestJSON-1846929961-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:37:38.900918 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-bc7846ce-baae-42c4-a339-427586caa6c9 tempest-ListServerFiltersTestJSON-1846929961 tempest-ListServerFiltersTestJSON-1846929961-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:37:38.902593 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-bc7846ce-baae-42c4-a339-427586caa6c9 tempest-ListServerFiltersTestJSON-1846929961 tempest-ListServerFiltersTestJSON-1846929961-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:37:38.943703 n-d-791503-6 nova-conductor[98843]: DEBUG nova.quota [None req-bc7846ce-baae-42c4-a339-427586caa6c9 tempest-ListServerFiltersTestJSON-1846929961 tempest-ListServerFiltersTestJSON-1846929961-project] Getting quotas for project f192e1538d3a4c0e89ac7d171bb7da01. Resources: {'cores', 'ram', 'instances'} {{(pid=98843) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 13:37:38.954566 n-d-791503-6 nova-conductor[98843]: DEBUG nova.quota [None req-bc7846ce-baae-42c4-a339-427586caa6c9 tempest-ListServerFiltersTestJSON-1846929961 tempest-ListServerFiltersTestJSON-1846929961-project] Getting quotas for user 33c06ec894a84405b8d7e3f1890f603f and project f192e1538d3a4c0e89ac7d171bb7da01. Resources: {'cores', 'ram', 'instances'} {{(pid=98843) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 13:37:38.979805 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-bc7846ce-baae-42c4-a339-427586caa6c9 tempest-ListServerFiltersTestJSON-1846929961 tempest-ListServerFiltersTestJSON-1846929961-project] [instance: 7bbfbd72-2ff1-4b75-9e7a-890bf1857ae5] Selected host: n-h2-791503-6; Selected node: n-h2-791503-6; Alternates: [('n-h1-791503-6', 'n-h1-791503-6')] {{(pid=98843) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 13:37:38.981865 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-bc7846ce-baae-42c4-a339-427586caa6c9 tempest-ListServerFiltersTestJSON-1846929961 tempest-ListServerFiltersTestJSON-1846929961-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:37:38.982838 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-bc7846ce-baae-42c4-a339-427586caa6c9 tempest-ListServerFiltersTestJSON-1846929961 tempest-ListServerFiltersTestJSON-1846929961-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:37:39.001893 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-bc7846ce-baae-42c4-a339-427586caa6c9 tempest-ListServerFiltersTestJSON-1846929961 tempest-ListServerFiltersTestJSON-1846929961-project] [instance: 7bbfbd72-2ff1-4b75-9e7a-890bf1857ae5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='64f6036b-99a9-40e4-8963-3cdf66964954',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98843) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 13:37:39.004775 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-bc7846ce-baae-42c4-a339-427586caa6c9 tempest-ListServerFiltersTestJSON-1846929961 tempest-ListServerFiltersTestJSON-1846929961-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:37:39.005910 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-bc7846ce-baae-42c4-a339-427586caa6c9 tempest-ListServerFiltersTestJSON-1846929961 tempest-ListServerFiltersTestJSON-1846929961-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:37:39.060603 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-bc7846ce-baae-42c4-a339-427586caa6c9 tempest-ListServerFiltersTestJSON-1846929961 tempest-ListServerFiltersTestJSON-1846929961-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:37:39.061007 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-bc7846ce-baae-42c4-a339-427586caa6c9 tempest-ListServerFiltersTestJSON-1846929961 tempest-ListServerFiltersTestJSON-1846929961-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:37:47.181813 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.manager [None req-939197d5-0e29-4310-93b3-55950cdb25b6 tempest-LiveAutoBlockMigrationV225Test-1477466171 tempest-LiveAutoBlockMigrationV225Test-1477466171-project] Took 0.48 seconds to select destinations for 1 instance(s). {{(pid=98844) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 13:37:47.237255 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-939197d5-0e29-4310-93b3-55950cdb25b6 tempest-LiveAutoBlockMigrationV225Test-1477466171 tempest-LiveAutoBlockMigrationV225Test-1477466171-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:37:47.238145 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-939197d5-0e29-4310-93b3-55950cdb25b6 tempest-LiveAutoBlockMigrationV225Test-1477466171 tempest-LiveAutoBlockMigrationV225Test-1477466171-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:37:47.393209 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-939197d5-0e29-4310-93b3-55950cdb25b6 tempest-LiveAutoBlockMigrationV225Test-1477466171 tempest-LiveAutoBlockMigrationV225Test-1477466171-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:37:47.397939 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-939197d5-0e29-4310-93b3-55950cdb25b6 tempest-LiveAutoBlockMigrationV225Test-1477466171 tempest-LiveAutoBlockMigrationV225Test-1477466171-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:37:47.405207 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-939197d5-0e29-4310-93b3-55950cdb25b6 tempest-LiveAutoBlockMigrationV225Test-1477466171 tempest-LiveAutoBlockMigrationV225Test-1477466171-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:37:47.407359 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-939197d5-0e29-4310-93b3-55950cdb25b6 tempest-LiveAutoBlockMigrationV225Test-1477466171 tempest-LiveAutoBlockMigrationV225Test-1477466171-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:37:47.481086 n-d-791503-6 nova-conductor[98844]: DEBUG nova.quota [None req-939197d5-0e29-4310-93b3-55950cdb25b6 tempest-LiveAutoBlockMigrationV225Test-1477466171 tempest-LiveAutoBlockMigrationV225Test-1477466171-project] Getting quotas for project 7196124f74dc4f2182b1810bc09cdad0. Resources: {'cores', 'ram', 'instances'} {{(pid=98844) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 13:37:47.503373 n-d-791503-6 nova-conductor[98844]: DEBUG nova.quota [None req-939197d5-0e29-4310-93b3-55950cdb25b6 tempest-LiveAutoBlockMigrationV225Test-1477466171 tempest-LiveAutoBlockMigrationV225Test-1477466171-project] Getting quotas for user d6f8e0f353fb4d25b3345c954b120a5e and project 7196124f74dc4f2182b1810bc09cdad0. Resources: {'cores', 'ram', 'instances'} {{(pid=98844) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 13:37:47.523734 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.manager [None req-939197d5-0e29-4310-93b3-55950cdb25b6 tempest-LiveAutoBlockMigrationV225Test-1477466171 tempest-LiveAutoBlockMigrationV225Test-1477466171-project] [instance: dc131d2d-46ce-4940-a940-e4c3e5c95a5f] Selected host: n-h1-791503-6; Selected node: n-h1-791503-6; Alternates: [('n-h2-791503-6', 'n-h2-791503-6')] {{(pid=98844) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 13:37:47.527437 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-939197d5-0e29-4310-93b3-55950cdb25b6 tempest-LiveAutoBlockMigrationV225Test-1477466171 tempest-LiveAutoBlockMigrationV225Test-1477466171-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:37:47.540328 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-939197d5-0e29-4310-93b3-55950cdb25b6 tempest-LiveAutoBlockMigrationV225Test-1477466171 tempest-LiveAutoBlockMigrationV225Test-1477466171-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:37:47.564926 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.manager [None req-939197d5-0e29-4310-93b3-55950cdb25b6 tempest-LiveAutoBlockMigrationV225Test-1477466171 tempest-LiveAutoBlockMigrationV225Test-1477466171-project] [instance: dc131d2d-46ce-4940-a940-e4c3e5c95a5f] block_device_mapping [BlockDeviceMapping(attachment_id=fcebf217-fbef-4474-8500-f9456c670f2d,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='4e53f00f-3797-4412-8592-2dcfd3f776c5',volume_size=1,volume_type=None)] {{(pid=98844) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 13:37:47.569900 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-939197d5-0e29-4310-93b3-55950cdb25b6 tempest-LiveAutoBlockMigrationV225Test-1477466171 tempest-LiveAutoBlockMigrationV225Test-1477466171-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:37:47.571457 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-939197d5-0e29-4310-93b3-55950cdb25b6 tempest-LiveAutoBlockMigrationV225Test-1477466171 tempest-LiveAutoBlockMigrationV225Test-1477466171-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:37:47.643233 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-939197d5-0e29-4310-93b3-55950cdb25b6 tempest-LiveAutoBlockMigrationV225Test-1477466171 tempest-LiveAutoBlockMigrationV225Test-1477466171-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:37:47.648026 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-939197d5-0e29-4310-93b3-55950cdb25b6 tempest-LiveAutoBlockMigrationV225Test-1477466171 tempest-LiveAutoBlockMigrationV225Test-1477466171-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:37:51.169385 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-8627cfca-6fa9-42ea-aa59-5517b3e0c541 tempest-ServersTestMultiNic-1021902988 tempest-ServersTestMultiNic-1021902988-project] Took 0.40 seconds to select destinations for 1 instance(s). {{(pid=98843) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 13:37:51.209542 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-8627cfca-6fa9-42ea-aa59-5517b3e0c541 tempest-ServersTestMultiNic-1021902988 tempest-ServersTestMultiNic-1021902988-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:37:51.210577 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-8627cfca-6fa9-42ea-aa59-5517b3e0c541 tempest-ServersTestMultiNic-1021902988 tempest-ServersTestMultiNic-1021902988-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:37:51.325841 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-8627cfca-6fa9-42ea-aa59-5517b3e0c541 tempest-ServersTestMultiNic-1021902988 tempest-ServersTestMultiNic-1021902988-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:37:51.327436 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-8627cfca-6fa9-42ea-aa59-5517b3e0c541 tempest-ServersTestMultiNic-1021902988 tempest-ServersTestMultiNic-1021902988-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:37:51.329401 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-8627cfca-6fa9-42ea-aa59-5517b3e0c541 tempest-ServersTestMultiNic-1021902988 tempest-ServersTestMultiNic-1021902988-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:37:51.330378 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-8627cfca-6fa9-42ea-aa59-5517b3e0c541 tempest-ServersTestMultiNic-1021902988 tempest-ServersTestMultiNic-1021902988-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:37:51.371452 n-d-791503-6 nova-conductor[98843]: DEBUG nova.quota [None req-8627cfca-6fa9-42ea-aa59-5517b3e0c541 tempest-ServersTestMultiNic-1021902988 tempest-ServersTestMultiNic-1021902988-project] Getting quotas for project 3bededc5d3824029ab8afc68746aa588. Resources: {'cores', 'ram', 'instances'} {{(pid=98843) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 13:37:51.383265 n-d-791503-6 nova-conductor[98843]: DEBUG nova.quota [None req-8627cfca-6fa9-42ea-aa59-5517b3e0c541 tempest-ServersTestMultiNic-1021902988 tempest-ServersTestMultiNic-1021902988-project] Getting quotas for user 50634b1ef3174a22a50a15aed2a6a009 and project 3bededc5d3824029ab8afc68746aa588. Resources: {'cores', 'ram', 'instances'} {{(pid=98843) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 13:37:51.412772 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-8627cfca-6fa9-42ea-aa59-5517b3e0c541 tempest-ServersTestMultiNic-1021902988 tempest-ServersTestMultiNic-1021902988-project] [instance: 90cd858a-5ad6-41d2-8fa4-755f8464b234] Selected host: n-h2-791503-6; Selected node: n-h2-791503-6; Alternates: [('n-h1-791503-6', 'n-h1-791503-6')] {{(pid=98843) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 13:37:51.415286 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-8627cfca-6fa9-42ea-aa59-5517b3e0c541 tempest-ServersTestMultiNic-1021902988 tempest-ServersTestMultiNic-1021902988-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:37:51.416565 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-8627cfca-6fa9-42ea-aa59-5517b3e0c541 tempest-ServersTestMultiNic-1021902988 tempest-ServersTestMultiNic-1021902988-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:37:51.459598 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-8627cfca-6fa9-42ea-aa59-5517b3e0c541 tempest-ServersTestMultiNic-1021902988 tempest-ServersTestMultiNic-1021902988-project] [instance: 90cd858a-5ad6-41d2-8fa4-755f8464b234] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='64f6036b-99a9-40e4-8963-3cdf66964954',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98843) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 13:37:51.465505 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-8627cfca-6fa9-42ea-aa59-5517b3e0c541 tempest-ServersTestMultiNic-1021902988 tempest-ServersTestMultiNic-1021902988-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:37:51.466168 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-8627cfca-6fa9-42ea-aa59-5517b3e0c541 tempest-ServersTestMultiNic-1021902988 tempest-ServersTestMultiNic-1021902988-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:37:51.543931 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-8627cfca-6fa9-42ea-aa59-5517b3e0c541 tempest-ServersTestMultiNic-1021902988 tempest-ServersTestMultiNic-1021902988-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:37:51.547161 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-8627cfca-6fa9-42ea-aa59-5517b3e0c541 tempest-ServersTestMultiNic-1021902988 tempest-ServersTestMultiNic-1021902988-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:38:24.937111 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.manager [None req-eda4a3f4-2dc6-4f60-8ddd-6e4b66206d21 tempest-FloatingIPsAssociationTestJSON-678246677 tempest-FloatingIPsAssociationTestJSON-678246677-project] Took 0.46 seconds to select destinations for 1 instance(s). {{(pid=98844) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 13:38:24.997011 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-eda4a3f4-2dc6-4f60-8ddd-6e4b66206d21 tempest-FloatingIPsAssociationTestJSON-678246677 tempest-FloatingIPsAssociationTestJSON-678246677-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:38:24.997575 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-eda4a3f4-2dc6-4f60-8ddd-6e4b66206d21 tempest-FloatingIPsAssociationTestJSON-678246677 tempest-FloatingIPsAssociationTestJSON-678246677-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:38:25.079947 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-eda4a3f4-2dc6-4f60-8ddd-6e4b66206d21 tempest-FloatingIPsAssociationTestJSON-678246677 tempest-FloatingIPsAssociationTestJSON-678246677-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:38:25.080513 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-eda4a3f4-2dc6-4f60-8ddd-6e4b66206d21 tempest-FloatingIPsAssociationTestJSON-678246677 tempest-FloatingIPsAssociationTestJSON-678246677-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:38:25.081515 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-eda4a3f4-2dc6-4f60-8ddd-6e4b66206d21 tempest-FloatingIPsAssociationTestJSON-678246677 tempest-FloatingIPsAssociationTestJSON-678246677-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:38:25.081934 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-eda4a3f4-2dc6-4f60-8ddd-6e4b66206d21 tempest-FloatingIPsAssociationTestJSON-678246677 tempest-FloatingIPsAssociationTestJSON-678246677-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:38:25.102471 n-d-791503-6 nova-conductor[98844]: DEBUG nova.quota [None req-eda4a3f4-2dc6-4f60-8ddd-6e4b66206d21 tempest-FloatingIPsAssociationTestJSON-678246677 tempest-FloatingIPsAssociationTestJSON-678246677-project] Getting quotas for project 517ebbf183e8416bb2e4778674a16961. Resources: {'cores', 'ram', 'instances'} {{(pid=98844) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 13:38:25.114049 n-d-791503-6 nova-conductor[98844]: DEBUG nova.quota [None req-eda4a3f4-2dc6-4f60-8ddd-6e4b66206d21 tempest-FloatingIPsAssociationTestJSON-678246677 tempest-FloatingIPsAssociationTestJSON-678246677-project] Getting quotas for user 465a0386f9cc4c1994ae8877dd8c461b and project 517ebbf183e8416bb2e4778674a16961. Resources: {'cores', 'ram', 'instances'} {{(pid=98844) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 13:38:25.128375 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.manager [None req-eda4a3f4-2dc6-4f60-8ddd-6e4b66206d21 tempest-FloatingIPsAssociationTestJSON-678246677 tempest-FloatingIPsAssociationTestJSON-678246677-project] [instance: 09f3acfe-72e9-4c5f-ad1c-3070e55b02a4] Selected host: n-h2-791503-6; Selected node: n-h2-791503-6; Alternates: [('n-h1-791503-6', 'n-h1-791503-6')] {{(pid=98844) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 13:38:25.129354 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-eda4a3f4-2dc6-4f60-8ddd-6e4b66206d21 tempest-FloatingIPsAssociationTestJSON-678246677 tempest-FloatingIPsAssociationTestJSON-678246677-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:38:25.129762 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-eda4a3f4-2dc6-4f60-8ddd-6e4b66206d21 tempest-FloatingIPsAssociationTestJSON-678246677 tempest-FloatingIPsAssociationTestJSON-678246677-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:38:25.143916 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.manager [None req-eda4a3f4-2dc6-4f60-8ddd-6e4b66206d21 tempest-FloatingIPsAssociationTestJSON-678246677 tempest-FloatingIPsAssociationTestJSON-678246677-project] [instance: 09f3acfe-72e9-4c5f-ad1c-3070e55b02a4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='64f6036b-99a9-40e4-8963-3cdf66964954',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98844) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 13:38:25.145347 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-eda4a3f4-2dc6-4f60-8ddd-6e4b66206d21 tempest-FloatingIPsAssociationTestJSON-678246677 tempest-FloatingIPsAssociationTestJSON-678246677-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:38:25.146118 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-eda4a3f4-2dc6-4f60-8ddd-6e4b66206d21 tempest-FloatingIPsAssociationTestJSON-678246677 tempest-FloatingIPsAssociationTestJSON-678246677-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:38:25.183414 n-d-791503-6 nova-conductor[98844]: ERROR oslo.messaging._drivers.impl_rabbit [-] [cbd7c90c-b59a-4f8b-992f-d04ba5ad6f9c] AMQP server on 10.222.0.68:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 28 13:38:25.223789 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-eda4a3f4-2dc6-4f60-8ddd-6e4b66206d21 tempest-FloatingIPsAssociationTestJSON-678246677 tempest-FloatingIPsAssociationTestJSON-678246677-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:38:25.224267 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-eda4a3f4-2dc6-4f60-8ddd-6e4b66206d21 tempest-FloatingIPsAssociationTestJSON-678246677 tempest-FloatingIPsAssociationTestJSON-678246677-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:38:26.208273 n-d-791503-6 nova-conductor[98844]: INFO oslo.messaging._drivers.impl_rabbit [-] [cbd7c90c-b59a-4f8b-992f-d04ba5ad6f9c] Reconnected to AMQP server on 10.222.0.68:5672 via [amqp] client with port 56494. May 28 13:38:29.057248 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-0e79e9aa-1f37-479f-ae32-58e587ec270d tempest-LiveAutoBlockMigrationV225Test-1459235087 tempest-LiveAutoBlockMigrationV225Test-1459235087-project-admin] Targeting cell b241212c-c279-4fbb-a1e7-b87889287cbf(cell1) for conductor method migrate_server {{(pid=98843) wrapper /opt/stack/nova/nova/conductor/manager.py:91}} May 28 13:38:29.058143 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-0e79e9aa-1f37-479f-ae32-58e587ec270d tempest-LiveAutoBlockMigrationV225Test-1459235087 tempest-LiveAutoBlockMigrationV225Test-1459235087-project-admin] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:38:29.058356 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-0e79e9aa-1f37-479f-ae32-58e587ec270d tempest-LiveAutoBlockMigrationV225Test-1459235087 tempest-LiveAutoBlockMigrationV225Test-1459235087-project-admin] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:38:29.710793 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.tasks.migrate [None req-0e79e9aa-1f37-479f-ae32-58e587ec270d tempest-LiveAutoBlockMigrationV225Test-1459235087 tempest-LiveAutoBlockMigrationV225Test-1459235087-project-admin] Created allocations for migration be5b832f-dca4-4187-8648-436615d5dcc4 on d4341c2e-3ff0-43f5-9b7e-4ec6191a47d4 {{(pid=98843) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} May 28 13:38:30.231744 n-d-791503-6 nova-conductor[98843]: DEBUG nova.scheduler.utils [None req-0e79e9aa-1f37-479f-ae32-58e587ec270d tempest-LiveAutoBlockMigrationV225Test-1459235087 tempest-LiveAutoBlockMigrationV225Test-1459235087-project-admin] [instance: dc131d2d-46ce-4940-a940-e4c3e5c95a5f] Instance allocations successfully created on destination node 5c5ac110-743a-4b71-a058-d2597ba8e0c9: {'allocations': {'5c5ac110-743a-4b71-a058-d2597ba8e0c9': {'resources': {'VCPU': 1, 'MEMORY_MB': 1024}}}} {{(pid=98843) claim_resources_on_destination /opt/stack/nova/nova/scheduler/utils.py:827}} May 28 13:38:30.232356 n-d-791503-6 nova-conductor[98843]: DEBUG nova.objects.instance [None req-0e79e9aa-1f37-479f-ae32-58e587ec270d tempest-LiveAutoBlockMigrationV225Test-1459235087 tempest-LiveAutoBlockMigrationV225Test-1459235087-project-admin] Lazy-loading 'resources' on Instance uuid dc131d2d-46ce-4940-a940-e4c3e5c95a5f {{(pid=98843) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 28 13:38:30.242388 n-d-791503-6 nova-conductor[98843]: DEBUG nova.objects.instance [None req-0e79e9aa-1f37-479f-ae32-58e587ec270d tempest-LiveAutoBlockMigrationV225Test-1459235087 tempest-LiveAutoBlockMigrationV225Test-1459235087-project-admin] Lazy-loading 'pci_requests' on Instance uuid dc131d2d-46ce-4940-a940-e4c3e5c95a5f {{(pid=98843) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 28 13:38:31.118796 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.tasks.live_migrate [None req-0e79e9aa-1f37-479f-ae32-58e587ec270d tempest-LiveAutoBlockMigrationV225Test-1459235087 tempest-LiveAutoBlockMigrationV225Test-1459235087-project-admin] [instance: dc131d2d-46ce-4940-a940-e4c3e5c95a5f] Start binding ports on destination host: n-h2-791503-6 {{(pid=98843) _bind_ports_on_destination /opt/stack/nova/nova/conductor/tasks/live_migrate.py:389}} May 28 13:38:47.690914 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.manager [None req-42a9c573-e33e-47a3-b29a-93ff99a3cb3f tempest-LiveMigrationTest-736720477 tempest-LiveMigrationTest-736720477-project] Took 0.38 seconds to select destinations for 1 instance(s). {{(pid=98844) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 13:38:47.813971 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-42a9c573-e33e-47a3-b29a-93ff99a3cb3f tempest-LiveMigrationTest-736720477 tempest-LiveMigrationTest-736720477-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:38:47.818165 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-42a9c573-e33e-47a3-b29a-93ff99a3cb3f tempest-LiveMigrationTest-736720477 tempest-LiveMigrationTest-736720477-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:38:47.986791 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-42a9c573-e33e-47a3-b29a-93ff99a3cb3f tempest-LiveMigrationTest-736720477 tempest-LiveMigrationTest-736720477-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:38:47.995300 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-42a9c573-e33e-47a3-b29a-93ff99a3cb3f tempest-LiveMigrationTest-736720477 tempest-LiveMigrationTest-736720477-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:38:47.997170 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-42a9c573-e33e-47a3-b29a-93ff99a3cb3f tempest-LiveMigrationTest-736720477 tempest-LiveMigrationTest-736720477-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:38:47.997560 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-42a9c573-e33e-47a3-b29a-93ff99a3cb3f tempest-LiveMigrationTest-736720477 tempest-LiveMigrationTest-736720477-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:38:48.072112 n-d-791503-6 nova-conductor[98844]: DEBUG nova.quota [None req-42a9c573-e33e-47a3-b29a-93ff99a3cb3f tempest-LiveMigrationTest-736720477 tempest-LiveMigrationTest-736720477-project] Getting quotas for project 876db6c4b6fe4dfb8d8783136238669a. Resources: {'cores', 'ram', 'instances'} {{(pid=98844) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 13:38:48.084931 n-d-791503-6 nova-conductor[98844]: DEBUG nova.quota [None req-42a9c573-e33e-47a3-b29a-93ff99a3cb3f tempest-LiveMigrationTest-736720477 tempest-LiveMigrationTest-736720477-project] Getting quotas for user 26ef8efd255740368f90ec8fa053c9a3 and project 876db6c4b6fe4dfb8d8783136238669a. Resources: {'cores', 'ram', 'instances'} {{(pid=98844) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 13:38:48.104322 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.manager [None req-42a9c573-e33e-47a3-b29a-93ff99a3cb3f tempest-LiveMigrationTest-736720477 tempest-LiveMigrationTest-736720477-project] [instance: 6e1fb675-cbcd-4a9e-bf4b-339f47c9a639] Selected host: n-h1-791503-6; Selected node: n-h1-791503-6; Alternates: [('n-h2-791503-6', 'n-h2-791503-6')] {{(pid=98844) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 13:38:48.105014 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-42a9c573-e33e-47a3-b29a-93ff99a3cb3f tempest-LiveMigrationTest-736720477 tempest-LiveMigrationTest-736720477-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:38:48.105591 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-42a9c573-e33e-47a3-b29a-93ff99a3cb3f tempest-LiveMigrationTest-736720477 tempest-LiveMigrationTest-736720477-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:38:48.114993 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.manager [None req-42a9c573-e33e-47a3-b29a-93ff99a3cb3f tempest-LiveMigrationTest-736720477 tempest-LiveMigrationTest-736720477-project] [instance: 6e1fb675-cbcd-4a9e-bf4b-339f47c9a639] block_device_mapping [BlockDeviceMapping(attachment_id=edeb2ca1-3b51-40b4-8e92-6f85d7d96d27,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='1dbaeb5c-3b12-4d34-8efc-a087594eec06',volume_size=1,volume_type=None)] {{(pid=98844) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 13:38:48.117917 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-42a9c573-e33e-47a3-b29a-93ff99a3cb3f tempest-LiveMigrationTest-736720477 tempest-LiveMigrationTest-736720477-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:38:48.121596 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-42a9c573-e33e-47a3-b29a-93ff99a3cb3f tempest-LiveMigrationTest-736720477 tempest-LiveMigrationTest-736720477-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:38:48.182830 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-42a9c573-e33e-47a3-b29a-93ff99a3cb3f tempest-LiveMigrationTest-736720477 tempest-LiveMigrationTest-736720477-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:38:48.183283 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-42a9c573-e33e-47a3-b29a-93ff99a3cb3f tempest-LiveMigrationTest-736720477 tempest-LiveMigrationTest-736720477-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:38:51.426904 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-e04618be-0fa3-499d-8ef8-96428de5be74 tempest-ImagesOneServerNegativeTestJSON-1003266287 tempest-ImagesOneServerNegativeTestJSON-1003266287-project] Took 0.57 seconds to select destinations for 1 instance(s). {{(pid=98843) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 13:38:51.479569 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-e04618be-0fa3-499d-8ef8-96428de5be74 tempest-ImagesOneServerNegativeTestJSON-1003266287 tempest-ImagesOneServerNegativeTestJSON-1003266287-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:38:51.480491 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-e04618be-0fa3-499d-8ef8-96428de5be74 tempest-ImagesOneServerNegativeTestJSON-1003266287 tempest-ImagesOneServerNegativeTestJSON-1003266287-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:38:51.584388 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-e04618be-0fa3-499d-8ef8-96428de5be74 tempest-ImagesOneServerNegativeTestJSON-1003266287 tempest-ImagesOneServerNegativeTestJSON-1003266287-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:38:51.585256 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-e04618be-0fa3-499d-8ef8-96428de5be74 tempest-ImagesOneServerNegativeTestJSON-1003266287 tempest-ImagesOneServerNegativeTestJSON-1003266287-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:38:51.586494 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-e04618be-0fa3-499d-8ef8-96428de5be74 tempest-ImagesOneServerNegativeTestJSON-1003266287 tempest-ImagesOneServerNegativeTestJSON-1003266287-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:38:51.587161 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-e04618be-0fa3-499d-8ef8-96428de5be74 tempest-ImagesOneServerNegativeTestJSON-1003266287 tempest-ImagesOneServerNegativeTestJSON-1003266287-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:38:51.626469 n-d-791503-6 nova-conductor[98843]: DEBUG nova.quota [None req-e04618be-0fa3-499d-8ef8-96428de5be74 tempest-ImagesOneServerNegativeTestJSON-1003266287 tempest-ImagesOneServerNegativeTestJSON-1003266287-project] Getting quotas for project c12f99538c984b508484f7d7b64f4827. Resources: {'cores', 'ram', 'instances'} {{(pid=98843) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 13:38:51.638281 n-d-791503-6 nova-conductor[98843]: DEBUG nova.quota [None req-e04618be-0fa3-499d-8ef8-96428de5be74 tempest-ImagesOneServerNegativeTestJSON-1003266287 tempest-ImagesOneServerNegativeTestJSON-1003266287-project] Getting quotas for user 1e15c7ce91e84f00977a299ac05ae5b0 and project c12f99538c984b508484f7d7b64f4827. Resources: {'cores', 'ram', 'instances'} {{(pid=98843) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 13:38:51.663052 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-e04618be-0fa3-499d-8ef8-96428de5be74 tempest-ImagesOneServerNegativeTestJSON-1003266287 tempest-ImagesOneServerNegativeTestJSON-1003266287-project] [instance: 65ebbc92-d748-48c9-9578-001f8b83979d] Selected host: n-h2-791503-6; Selected node: n-h2-791503-6; Alternates: [('n-h1-791503-6', 'n-h1-791503-6')] {{(pid=98843) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 13:38:51.664801 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-e04618be-0fa3-499d-8ef8-96428de5be74 tempest-ImagesOneServerNegativeTestJSON-1003266287 tempest-ImagesOneServerNegativeTestJSON-1003266287-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:38:51.665540 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-e04618be-0fa3-499d-8ef8-96428de5be74 tempest-ImagesOneServerNegativeTestJSON-1003266287 tempest-ImagesOneServerNegativeTestJSON-1003266287-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:38:51.680089 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-e04618be-0fa3-499d-8ef8-96428de5be74 tempest-ImagesOneServerNegativeTestJSON-1003266287 tempest-ImagesOneServerNegativeTestJSON-1003266287-project] [instance: 65ebbc92-d748-48c9-9578-001f8b83979d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='64f6036b-99a9-40e4-8963-3cdf66964954',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98843) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 13:38:51.683908 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-e04618be-0fa3-499d-8ef8-96428de5be74 tempest-ImagesOneServerNegativeTestJSON-1003266287 tempest-ImagesOneServerNegativeTestJSON-1003266287-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:38:51.685796 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-e04618be-0fa3-499d-8ef8-96428de5be74 tempest-ImagesOneServerNegativeTestJSON-1003266287 tempest-ImagesOneServerNegativeTestJSON-1003266287-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:38:51.745464 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-e04618be-0fa3-499d-8ef8-96428de5be74 tempest-ImagesOneServerNegativeTestJSON-1003266287 tempest-ImagesOneServerNegativeTestJSON-1003266287-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:38:51.745846 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-e04618be-0fa3-499d-8ef8-96428de5be74 tempest-ImagesOneServerNegativeTestJSON-1003266287 tempest-ImagesOneServerNegativeTestJSON-1003266287-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:39:26.746349 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.manager [None req-13c32dc2-96e9-469d-8ccb-89f473956e64 tempest-ServersTestManualDisk-482746783 tempest-ServersTestManualDisk-482746783-project] Took 0.56 seconds to select destinations for 1 instance(s). {{(pid=98844) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 13:39:26.796754 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-13c32dc2-96e9-469d-8ccb-89f473956e64 tempest-ServersTestManualDisk-482746783 tempest-ServersTestManualDisk-482746783-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:39:26.798918 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-13c32dc2-96e9-469d-8ccb-89f473956e64 tempest-ServersTestManualDisk-482746783 tempest-ServersTestManualDisk-482746783-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:39:26.908504 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-13c32dc2-96e9-469d-8ccb-89f473956e64 tempest-ServersTestManualDisk-482746783 tempest-ServersTestManualDisk-482746783-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:39:26.909005 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-13c32dc2-96e9-469d-8ccb-89f473956e64 tempest-ServersTestManualDisk-482746783 tempest-ServersTestManualDisk-482746783-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:39:26.916708 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-13c32dc2-96e9-469d-8ccb-89f473956e64 tempest-ServersTestManualDisk-482746783 tempest-ServersTestManualDisk-482746783-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:39:26.918208 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-13c32dc2-96e9-469d-8ccb-89f473956e64 tempest-ServersTestManualDisk-482746783 tempest-ServersTestManualDisk-482746783-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:39:26.954786 n-d-791503-6 nova-conductor[98844]: DEBUG nova.quota [None req-13c32dc2-96e9-469d-8ccb-89f473956e64 tempest-ServersTestManualDisk-482746783 tempest-ServersTestManualDisk-482746783-project] Getting quotas for project 86b3d21347394aff947cff185cc3eca0. Resources: {'cores', 'ram', 'instances'} {{(pid=98844) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 13:39:26.968198 n-d-791503-6 nova-conductor[98844]: DEBUG nova.quota [None req-13c32dc2-96e9-469d-8ccb-89f473956e64 tempest-ServersTestManualDisk-482746783 tempest-ServersTestManualDisk-482746783-project] Getting quotas for user 139169ae69b3462c89cfea69d1a6cd2c and project 86b3d21347394aff947cff185cc3eca0. Resources: {'cores', 'ram', 'instances'} {{(pid=98844) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 13:39:26.995632 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.manager [None req-13c32dc2-96e9-469d-8ccb-89f473956e64 tempest-ServersTestManualDisk-482746783 tempest-ServersTestManualDisk-482746783-project] [instance: dee9b0ea-ceba-4fcc-9263-07f73cf84520] Selected host: n-h2-791503-6; Selected node: n-h2-791503-6; Alternates: [('n-h1-791503-6', 'n-h1-791503-6')] {{(pid=98844) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 13:39:26.997566 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-13c32dc2-96e9-469d-8ccb-89f473956e64 tempest-ServersTestManualDisk-482746783 tempest-ServersTestManualDisk-482746783-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:39:26.998315 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-13c32dc2-96e9-469d-8ccb-89f473956e64 tempest-ServersTestManualDisk-482746783 tempest-ServersTestManualDisk-482746783-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:39:27.013364 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.manager [None req-13c32dc2-96e9-469d-8ccb-89f473956e64 tempest-ServersTestManualDisk-482746783 tempest-ServersTestManualDisk-482746783-project] [instance: dee9b0ea-ceba-4fcc-9263-07f73cf84520] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='64f6036b-99a9-40e4-8963-3cdf66964954',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98844) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 13:39:27.016472 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-13c32dc2-96e9-469d-8ccb-89f473956e64 tempest-ServersTestManualDisk-482746783 tempest-ServersTestManualDisk-482746783-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:39:27.017217 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-13c32dc2-96e9-469d-8ccb-89f473956e64 tempest-ServersTestManualDisk-482746783 tempest-ServersTestManualDisk-482746783-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:39:27.084485 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-13c32dc2-96e9-469d-8ccb-89f473956e64 tempest-ServersTestManualDisk-482746783 tempest-ServersTestManualDisk-482746783-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:39:27.085686 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-13c32dc2-96e9-469d-8ccb-89f473956e64 tempest-ServersTestManualDisk-482746783 tempest-ServersTestManualDisk-482746783-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:39:55.745698 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-5f3627b0-fd6b-41c4-b04d-faf77936e530 tempest-LiveMigrationTest-384423165 tempest-LiveMigrationTest-384423165-project-admin] Targeting cell b241212c-c279-4fbb-a1e7-b87889287cbf(cell1) for conductor method migrate_server {{(pid=98843) wrapper /opt/stack/nova/nova/conductor/manager.py:91}} May 28 13:39:55.746905 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-5f3627b0-fd6b-41c4-b04d-faf77936e530 tempest-LiveMigrationTest-384423165 tempest-LiveMigrationTest-384423165-project-admin] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:39:55.748449 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-5f3627b0-fd6b-41c4-b04d-faf77936e530 tempest-LiveMigrationTest-384423165 tempest-LiveMigrationTest-384423165-project-admin] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:39:56.950178 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.tasks.migrate [None req-5f3627b0-fd6b-41c4-b04d-faf77936e530 tempest-LiveMigrationTest-384423165 tempest-LiveMigrationTest-384423165-project-admin] Created allocations for migration 6f4f8754-f1b0-479d-a515-38c19ab7b3ea on d4341c2e-3ff0-43f5-9b7e-4ec6191a47d4 {{(pid=98843) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} May 28 13:39:57.249229 n-d-791503-6 nova-conductor[98843]: DEBUG nova.scheduler.utils [None req-5f3627b0-fd6b-41c4-b04d-faf77936e530 tempest-LiveMigrationTest-384423165 tempest-LiveMigrationTest-384423165-project-admin] [instance: 6e1fb675-cbcd-4a9e-bf4b-339f47c9a639] Instance allocations successfully created on destination node 5c5ac110-743a-4b71-a058-d2597ba8e0c9: {'allocations': {'5c5ac110-743a-4b71-a058-d2597ba8e0c9': {'resources': {'VCPU': 1, 'MEMORY_MB': 1024}}}} {{(pid=98843) claim_resources_on_destination /opt/stack/nova/nova/scheduler/utils.py:827}} May 28 13:39:57.250219 n-d-791503-6 nova-conductor[98843]: DEBUG nova.objects.instance [None req-5f3627b0-fd6b-41c4-b04d-faf77936e530 tempest-LiveMigrationTest-384423165 tempest-LiveMigrationTest-384423165-project-admin] Lazy-loading 'resources' on Instance uuid 6e1fb675-cbcd-4a9e-bf4b-339f47c9a639 {{(pid=98843) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 28 13:39:57.267206 n-d-791503-6 nova-conductor[98843]: DEBUG nova.objects.instance [None req-5f3627b0-fd6b-41c4-b04d-faf77936e530 tempest-LiveMigrationTest-384423165 tempest-LiveMigrationTest-384423165-project-admin] Lazy-loading 'pci_requests' on Instance uuid 6e1fb675-cbcd-4a9e-bf4b-339f47c9a639 {{(pid=98843) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 28 13:39:57.912406 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.tasks.live_migrate [None req-5f3627b0-fd6b-41c4-b04d-faf77936e530 tempest-LiveMigrationTest-384423165 tempest-LiveMigrationTest-384423165-project-admin] [instance: 6e1fb675-cbcd-4a9e-bf4b-339f47c9a639] Start binding ports on destination host: n-h2-791503-6 {{(pid=98843) _bind_ports_on_destination /opt/stack/nova/nova/conductor/tasks/live_migrate.py:389}} May 28 13:40:30.937650 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.manager [None req-b47aeea0-d63c-4edb-9c0b-b8a2b0b49645 tempest-ServerActionsTestJSON-1981342857 tempest-ServerActionsTestJSON-1981342857-project] Took 0.61 seconds to select destinations for 1 instance(s). {{(pid=98844) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 13:40:31.009872 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-b47aeea0-d63c-4edb-9c0b-b8a2b0b49645 tempest-ServerActionsTestJSON-1981342857 tempest-ServerActionsTestJSON-1981342857-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:40:31.016712 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-b47aeea0-d63c-4edb-9c0b-b8a2b0b49645 tempest-ServerActionsTestJSON-1981342857 tempest-ServerActionsTestJSON-1981342857-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:40:31.151445 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-b47aeea0-d63c-4edb-9c0b-b8a2b0b49645 tempest-ServerActionsTestJSON-1981342857 tempest-ServerActionsTestJSON-1981342857-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:40:31.152467 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-b47aeea0-d63c-4edb-9c0b-b8a2b0b49645 tempest-ServerActionsTestJSON-1981342857 tempest-ServerActionsTestJSON-1981342857-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:40:31.154515 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-b47aeea0-d63c-4edb-9c0b-b8a2b0b49645 tempest-ServerActionsTestJSON-1981342857 tempest-ServerActionsTestJSON-1981342857-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:40:31.155941 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-b47aeea0-d63c-4edb-9c0b-b8a2b0b49645 tempest-ServerActionsTestJSON-1981342857 tempest-ServerActionsTestJSON-1981342857-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:40:31.195744 n-d-791503-6 nova-conductor[98844]: DEBUG nova.quota [None req-b47aeea0-d63c-4edb-9c0b-b8a2b0b49645 tempest-ServerActionsTestJSON-1981342857 tempest-ServerActionsTestJSON-1981342857-project] Getting quotas for project 5938fa909b2b41f3b9c83d7bed85496e. Resources: {'cores', 'ram', 'instances'} {{(pid=98844) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 13:40:31.206750 n-d-791503-6 nova-conductor[98844]: DEBUG nova.quota [None req-b47aeea0-d63c-4edb-9c0b-b8a2b0b49645 tempest-ServerActionsTestJSON-1981342857 tempest-ServerActionsTestJSON-1981342857-project] Getting quotas for user b0fd2f9f85864877a8044e864e9eed29 and project 5938fa909b2b41f3b9c83d7bed85496e. Resources: {'cores', 'ram', 'instances'} {{(pid=98844) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 13:40:31.232520 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.manager [None req-b47aeea0-d63c-4edb-9c0b-b8a2b0b49645 tempest-ServerActionsTestJSON-1981342857 tempest-ServerActionsTestJSON-1981342857-project] [instance: 42209a70-a952-4efb-8cfc-639e3c7cb64a] Selected host: n-h2-791503-6; Selected node: n-h2-791503-6; Alternates: [('n-h1-791503-6', 'n-h1-791503-6')] {{(pid=98844) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 13:40:31.235630 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-b47aeea0-d63c-4edb-9c0b-b8a2b0b49645 tempest-ServerActionsTestJSON-1981342857 tempest-ServerActionsTestJSON-1981342857-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:40:31.236871 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-b47aeea0-d63c-4edb-9c0b-b8a2b0b49645 tempest-ServerActionsTestJSON-1981342857 tempest-ServerActionsTestJSON-1981342857-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:40:31.251669 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.manager [None req-b47aeea0-d63c-4edb-9c0b-b8a2b0b49645 tempest-ServerActionsTestJSON-1981342857 tempest-ServerActionsTestJSON-1981342857-project] [instance: 42209a70-a952-4efb-8cfc-639e3c7cb64a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='64f6036b-99a9-40e4-8963-3cdf66964954',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98844) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 13:40:31.254819 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-b47aeea0-d63c-4edb-9c0b-b8a2b0b49645 tempest-ServerActionsTestJSON-1981342857 tempest-ServerActionsTestJSON-1981342857-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:40:31.256004 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-b47aeea0-d63c-4edb-9c0b-b8a2b0b49645 tempest-ServerActionsTestJSON-1981342857 tempest-ServerActionsTestJSON-1981342857-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:40:31.338952 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-b47aeea0-d63c-4edb-9c0b-b8a2b0b49645 tempest-ServerActionsTestJSON-1981342857 tempest-ServerActionsTestJSON-1981342857-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:40:31.339757 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-b47aeea0-d63c-4edb-9c0b-b8a2b0b49645 tempest-ServerActionsTestJSON-1981342857 tempest-ServerActionsTestJSON-1981342857-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:40:39.154531 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-d85d92be-e7bf-494a-bdd1-8493fcc08651 tempest-ImagesOneServerNegativeTestJSON-1003266287 tempest-ImagesOneServerNegativeTestJSON-1003266287-project] Took 0.84 seconds to select destinations for 1 instance(s). {{(pid=98843) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 13:40:39.233258 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-d85d92be-e7bf-494a-bdd1-8493fcc08651 tempest-ImagesOneServerNegativeTestJSON-1003266287 tempest-ImagesOneServerNegativeTestJSON-1003266287-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:40:39.234015 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-d85d92be-e7bf-494a-bdd1-8493fcc08651 tempest-ImagesOneServerNegativeTestJSON-1003266287 tempest-ImagesOneServerNegativeTestJSON-1003266287-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:40:39.353296 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-d85d92be-e7bf-494a-bdd1-8493fcc08651 tempest-ImagesOneServerNegativeTestJSON-1003266287 tempest-ImagesOneServerNegativeTestJSON-1003266287-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:40:39.353705 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-d85d92be-e7bf-494a-bdd1-8493fcc08651 tempest-ImagesOneServerNegativeTestJSON-1003266287 tempest-ImagesOneServerNegativeTestJSON-1003266287-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:40:39.358009 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-d85d92be-e7bf-494a-bdd1-8493fcc08651 tempest-ImagesOneServerNegativeTestJSON-1003266287 tempest-ImagesOneServerNegativeTestJSON-1003266287-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:40:39.358460 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-d85d92be-e7bf-494a-bdd1-8493fcc08651 tempest-ImagesOneServerNegativeTestJSON-1003266287 tempest-ImagesOneServerNegativeTestJSON-1003266287-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:40:39.407798 n-d-791503-6 nova-conductor[98843]: DEBUG nova.quota [None req-d85d92be-e7bf-494a-bdd1-8493fcc08651 tempest-ImagesOneServerNegativeTestJSON-1003266287 tempest-ImagesOneServerNegativeTestJSON-1003266287-project] Getting quotas for project c12f99538c984b508484f7d7b64f4827. Resources: {'cores', 'ram', 'instances'} {{(pid=98843) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 13:40:39.428366 n-d-791503-6 nova-conductor[98843]: DEBUG nova.quota [None req-d85d92be-e7bf-494a-bdd1-8493fcc08651 tempest-ImagesOneServerNegativeTestJSON-1003266287 tempest-ImagesOneServerNegativeTestJSON-1003266287-project] Getting quotas for user 1e15c7ce91e84f00977a299ac05ae5b0 and project c12f99538c984b508484f7d7b64f4827. Resources: {'cores', 'ram', 'instances'} {{(pid=98843) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 13:40:39.459882 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-d85d92be-e7bf-494a-bdd1-8493fcc08651 tempest-ImagesOneServerNegativeTestJSON-1003266287 tempest-ImagesOneServerNegativeTestJSON-1003266287-project] [instance: 9179aa07-4883-4866-bc66-4723a4f2ed8a] Selected host: n-h1-791503-6; Selected node: n-h1-791503-6; Alternates: [('n-h2-791503-6', 'n-h2-791503-6')] {{(pid=98843) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 13:40:39.461012 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-d85d92be-e7bf-494a-bdd1-8493fcc08651 tempest-ImagesOneServerNegativeTestJSON-1003266287 tempest-ImagesOneServerNegativeTestJSON-1003266287-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:40:39.463297 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-d85d92be-e7bf-494a-bdd1-8493fcc08651 tempest-ImagesOneServerNegativeTestJSON-1003266287 tempest-ImagesOneServerNegativeTestJSON-1003266287-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:40:39.486797 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-d85d92be-e7bf-494a-bdd1-8493fcc08651 tempest-ImagesOneServerNegativeTestJSON-1003266287 tempest-ImagesOneServerNegativeTestJSON-1003266287-project] [instance: 9179aa07-4883-4866-bc66-4723a4f2ed8a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='64f6036b-99a9-40e4-8963-3cdf66964954',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98843) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 13:40:39.488694 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-d85d92be-e7bf-494a-bdd1-8493fcc08651 tempest-ImagesOneServerNegativeTestJSON-1003266287 tempest-ImagesOneServerNegativeTestJSON-1003266287-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:40:39.489230 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-d85d92be-e7bf-494a-bdd1-8493fcc08651 tempest-ImagesOneServerNegativeTestJSON-1003266287 tempest-ImagesOneServerNegativeTestJSON-1003266287-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:40:39.570245 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-d85d92be-e7bf-494a-bdd1-8493fcc08651 tempest-ImagesOneServerNegativeTestJSON-1003266287 tempest-ImagesOneServerNegativeTestJSON-1003266287-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:40:39.571111 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-d85d92be-e7bf-494a-bdd1-8493fcc08651 tempest-ImagesOneServerNegativeTestJSON-1003266287 tempest-ImagesOneServerNegativeTestJSON-1003266287-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:40:45.979245 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.manager [None req-c6a45275-3c56-484f-bc34-d5ed345071cf tempest-MigrationsAdminTest-1666574026 tempest-MigrationsAdminTest-1666574026-project] Took 0.49 seconds to select destinations for 1 instance(s). {{(pid=98844) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 13:40:46.140249 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-c6a45275-3c56-484f-bc34-d5ed345071cf tempest-MigrationsAdminTest-1666574026 tempest-MigrationsAdminTest-1666574026-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:40:46.145929 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-c6a45275-3c56-484f-bc34-d5ed345071cf tempest-MigrationsAdminTest-1666574026 tempest-MigrationsAdminTest-1666574026-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:40:46.308601 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-c6a45275-3c56-484f-bc34-d5ed345071cf tempest-MigrationsAdminTest-1666574026 tempest-MigrationsAdminTest-1666574026-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:40:46.309230 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-c6a45275-3c56-484f-bc34-d5ed345071cf tempest-MigrationsAdminTest-1666574026 tempest-MigrationsAdminTest-1666574026-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:40:46.310329 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-c6a45275-3c56-484f-bc34-d5ed345071cf tempest-MigrationsAdminTest-1666574026 tempest-MigrationsAdminTest-1666574026-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:40:46.310944 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-c6a45275-3c56-484f-bc34-d5ed345071cf tempest-MigrationsAdminTest-1666574026 tempest-MigrationsAdminTest-1666574026-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:40:46.345749 n-d-791503-6 nova-conductor[98844]: DEBUG nova.quota [None req-c6a45275-3c56-484f-bc34-d5ed345071cf tempest-MigrationsAdminTest-1666574026 tempest-MigrationsAdminTest-1666574026-project] Getting quotas for project 1df09ab4f06c415fb230001e945a2e55. Resources: {'cores', 'ram', 'instances'} {{(pid=98844) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 13:40:46.359032 n-d-791503-6 nova-conductor[98844]: DEBUG nova.quota [None req-c6a45275-3c56-484f-bc34-d5ed345071cf tempest-MigrationsAdminTest-1666574026 tempest-MigrationsAdminTest-1666574026-project] Getting quotas for user 18b64baf715545358827a2c540135008 and project 1df09ab4f06c415fb230001e945a2e55. Resources: {'cores', 'ram', 'instances'} {{(pid=98844) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 13:40:46.399501 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.manager [None req-c6a45275-3c56-484f-bc34-d5ed345071cf tempest-MigrationsAdminTest-1666574026 tempest-MigrationsAdminTest-1666574026-project] [instance: 3fa8f703-f364-4070-9625-67cabad30e71] Selected host: n-h1-791503-6; Selected node: n-h1-791503-6; Alternates: [('n-h2-791503-6', 'n-h2-791503-6')] {{(pid=98844) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 13:40:46.401765 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-c6a45275-3c56-484f-bc34-d5ed345071cf tempest-MigrationsAdminTest-1666574026 tempest-MigrationsAdminTest-1666574026-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:40:46.402673 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-c6a45275-3c56-484f-bc34-d5ed345071cf tempest-MigrationsAdminTest-1666574026 tempest-MigrationsAdminTest-1666574026-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:40:46.416541 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.manager [None req-c6a45275-3c56-484f-bc34-d5ed345071cf tempest-MigrationsAdminTest-1666574026 tempest-MigrationsAdminTest-1666574026-project] [instance: 3fa8f703-f364-4070-9625-67cabad30e71] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='64f6036b-99a9-40e4-8963-3cdf66964954',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98844) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 13:40:46.422859 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-c6a45275-3c56-484f-bc34-d5ed345071cf tempest-MigrationsAdminTest-1666574026 tempest-MigrationsAdminTest-1666574026-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:40:46.423970 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-c6a45275-3c56-484f-bc34-d5ed345071cf tempest-MigrationsAdminTest-1666574026 tempest-MigrationsAdminTest-1666574026-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:40:46.527696 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-c6a45275-3c56-484f-bc34-d5ed345071cf tempest-MigrationsAdminTest-1666574026 tempest-MigrationsAdminTest-1666574026-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:40:46.529823 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-c6a45275-3c56-484f-bc34-d5ed345071cf tempest-MigrationsAdminTest-1666574026 tempest-MigrationsAdminTest-1666574026-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:40:54.664788 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-2464f126-f7bd-481a-9a03-fd3a65f0a785 tempest-ServerDiagnosticsNegativeTest-1926220028 tempest-ServerDiagnosticsNegativeTest-1926220028-project] Took 0.46 seconds to select destinations for 1 instance(s). {{(pid=98843) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 13:40:54.699137 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-2464f126-f7bd-481a-9a03-fd3a65f0a785 tempest-ServerDiagnosticsNegativeTest-1926220028 tempest-ServerDiagnosticsNegativeTest-1926220028-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:40:54.699828 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-2464f126-f7bd-481a-9a03-fd3a65f0a785 tempest-ServerDiagnosticsNegativeTest-1926220028 tempest-ServerDiagnosticsNegativeTest-1926220028-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:40:54.796360 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-2464f126-f7bd-481a-9a03-fd3a65f0a785 tempest-ServerDiagnosticsNegativeTest-1926220028 tempest-ServerDiagnosticsNegativeTest-1926220028-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:40:54.797820 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-2464f126-f7bd-481a-9a03-fd3a65f0a785 tempest-ServerDiagnosticsNegativeTest-1926220028 tempest-ServerDiagnosticsNegativeTest-1926220028-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:40:54.799570 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-2464f126-f7bd-481a-9a03-fd3a65f0a785 tempest-ServerDiagnosticsNegativeTest-1926220028 tempest-ServerDiagnosticsNegativeTest-1926220028-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:40:54.800449 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-2464f126-f7bd-481a-9a03-fd3a65f0a785 tempest-ServerDiagnosticsNegativeTest-1926220028 tempest-ServerDiagnosticsNegativeTest-1926220028-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:40:54.827619 n-d-791503-6 nova-conductor[98843]: DEBUG nova.quota [None req-2464f126-f7bd-481a-9a03-fd3a65f0a785 tempest-ServerDiagnosticsNegativeTest-1926220028 tempest-ServerDiagnosticsNegativeTest-1926220028-project] Getting quotas for project d56f0f199cd944a9b2361effdd7dc286. Resources: {'cores', 'ram', 'instances'} {{(pid=98843) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 13:40:54.834012 n-d-791503-6 nova-conductor[98843]: DEBUG nova.quota [None req-2464f126-f7bd-481a-9a03-fd3a65f0a785 tempest-ServerDiagnosticsNegativeTest-1926220028 tempest-ServerDiagnosticsNegativeTest-1926220028-project] Getting quotas for user 38bdf064f461409696c535ec5035c182 and project d56f0f199cd944a9b2361effdd7dc286. Resources: {'cores', 'ram', 'instances'} {{(pid=98843) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 13:40:54.854762 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-2464f126-f7bd-481a-9a03-fd3a65f0a785 tempest-ServerDiagnosticsNegativeTest-1926220028 tempest-ServerDiagnosticsNegativeTest-1926220028-project] [instance: ea93de94-3427-4eaf-b216-0c99289ad8ef] Selected host: n-h2-791503-6; Selected node: n-h2-791503-6; Alternates: [('n-h1-791503-6', 'n-h1-791503-6')] {{(pid=98843) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 13:40:54.856261 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-2464f126-f7bd-481a-9a03-fd3a65f0a785 tempest-ServerDiagnosticsNegativeTest-1926220028 tempest-ServerDiagnosticsNegativeTest-1926220028-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:40:54.856840 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-2464f126-f7bd-481a-9a03-fd3a65f0a785 tempest-ServerDiagnosticsNegativeTest-1926220028 tempest-ServerDiagnosticsNegativeTest-1926220028-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:40:54.867051 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-2464f126-f7bd-481a-9a03-fd3a65f0a785 tempest-ServerDiagnosticsNegativeTest-1926220028 tempest-ServerDiagnosticsNegativeTest-1926220028-project] [instance: ea93de94-3427-4eaf-b216-0c99289ad8ef] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='64f6036b-99a9-40e4-8963-3cdf66964954',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98843) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 13:40:54.870039 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-2464f126-f7bd-481a-9a03-fd3a65f0a785 tempest-ServerDiagnosticsNegativeTest-1926220028 tempest-ServerDiagnosticsNegativeTest-1926220028-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:40:54.870902 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-2464f126-f7bd-481a-9a03-fd3a65f0a785 tempest-ServerDiagnosticsNegativeTest-1926220028 tempest-ServerDiagnosticsNegativeTest-1926220028-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:40:54.917214 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-2464f126-f7bd-481a-9a03-fd3a65f0a785 tempest-ServerDiagnosticsNegativeTest-1926220028 tempest-ServerDiagnosticsNegativeTest-1926220028-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:40:54.918246 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-2464f126-f7bd-481a-9a03-fd3a65f0a785 tempest-ServerDiagnosticsNegativeTest-1926220028 tempest-ServerDiagnosticsNegativeTest-1926220028-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:41:01.989605 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.manager [None req-d6c95679-f622-4d5b-b019-c45191de03e9 tempest-ServersNegativeTestJSON-848961242 tempest-ServersNegativeTestJSON-848961242-project] Took 1.25 seconds to select destinations for 1 instance(s). {{(pid=98844) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 13:41:02.020036 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-d6c95679-f622-4d5b-b019-c45191de03e9 tempest-ServersNegativeTestJSON-848961242 tempest-ServersNegativeTestJSON-848961242-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:41:02.020741 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-d6c95679-f622-4d5b-b019-c45191de03e9 tempest-ServersNegativeTestJSON-848961242 tempest-ServersNegativeTestJSON-848961242-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:41:02.100173 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-d6c95679-f622-4d5b-b019-c45191de03e9 tempest-ServersNegativeTestJSON-848961242 tempest-ServersNegativeTestJSON-848961242-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:41:02.101054 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-d6c95679-f622-4d5b-b019-c45191de03e9 tempest-ServersNegativeTestJSON-848961242 tempest-ServersNegativeTestJSON-848961242-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:41:02.102259 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-d6c95679-f622-4d5b-b019-c45191de03e9 tempest-ServersNegativeTestJSON-848961242 tempest-ServersNegativeTestJSON-848961242-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:41:02.102917 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-d6c95679-f622-4d5b-b019-c45191de03e9 tempest-ServersNegativeTestJSON-848961242 tempest-ServersNegativeTestJSON-848961242-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:41:02.125157 n-d-791503-6 nova-conductor[98844]: DEBUG nova.quota [None req-d6c95679-f622-4d5b-b019-c45191de03e9 tempest-ServersNegativeTestJSON-848961242 tempest-ServersNegativeTestJSON-848961242-project] Getting quotas for project 3817dfafb60f4d3199f72eb2fd7cb3b4. Resources: {'cores', 'ram', 'instances'} {{(pid=98844) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 13:41:02.131108 n-d-791503-6 nova-conductor[98844]: DEBUG nova.quota [None req-d6c95679-f622-4d5b-b019-c45191de03e9 tempest-ServersNegativeTestJSON-848961242 tempest-ServersNegativeTestJSON-848961242-project] Getting quotas for user ef5ac584e7334508b42515488eb984be and project 3817dfafb60f4d3199f72eb2fd7cb3b4. Resources: {'cores', 'ram', 'instances'} {{(pid=98844) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 13:41:02.176048 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.manager [None req-d6c95679-f622-4d5b-b019-c45191de03e9 tempest-ServersNegativeTestJSON-848961242 tempest-ServersNegativeTestJSON-848961242-project] [instance: 35dac88f-ae2f-4199-ba19-6d0c12ddcc04] Selected host: n-h1-791503-6; Selected node: n-h1-791503-6; Alternates: [('n-h2-791503-6', 'n-h2-791503-6')] {{(pid=98844) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 13:41:02.178787 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-d6c95679-f622-4d5b-b019-c45191de03e9 tempest-ServersNegativeTestJSON-848961242 tempest-ServersNegativeTestJSON-848961242-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:41:02.181331 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-d6c95679-f622-4d5b-b019-c45191de03e9 tempest-ServersNegativeTestJSON-848961242 tempest-ServersNegativeTestJSON-848961242-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:41:02.196689 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.manager [None req-d6c95679-f622-4d5b-b019-c45191de03e9 tempest-ServersNegativeTestJSON-848961242 tempest-ServersNegativeTestJSON-848961242-project] [instance: 35dac88f-ae2f-4199-ba19-6d0c12ddcc04] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='64f6036b-99a9-40e4-8963-3cdf66964954',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98844) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 13:41:02.198542 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-d6c95679-f622-4d5b-b019-c45191de03e9 tempest-ServersNegativeTestJSON-848961242 tempest-ServersNegativeTestJSON-848961242-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:41:02.199525 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-d6c95679-f622-4d5b-b019-c45191de03e9 tempest-ServersNegativeTestJSON-848961242 tempest-ServersNegativeTestJSON-848961242-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:41:02.283711 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-d6c95679-f622-4d5b-b019-c45191de03e9 tempest-ServersNegativeTestJSON-848961242 tempest-ServersNegativeTestJSON-848961242-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:41:02.284588 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-d6c95679-f622-4d5b-b019-c45191de03e9 tempest-ServersNegativeTestJSON-848961242 tempest-ServersNegativeTestJSON-848961242-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:41:26.210719 n-d-791503-6 nova-conductor[98844]: ERROR oslo.messaging._drivers.impl_rabbit [-] [cbd7c90c-b59a-4f8b-992f-d04ba5ad6f9c] AMQP server on 10.222.0.68:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 28 13:41:27.250054 n-d-791503-6 nova-conductor[98844]: INFO oslo.messaging._drivers.impl_rabbit [-] [cbd7c90c-b59a-4f8b-992f-d04ba5ad6f9c] Reconnected to AMQP server on 10.222.0.68:5672 via [amqp] client with port 58342. May 28 13:41:28.044356 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-dcc968a8-53e3-4ced-b395-3a715d8a0561 tempest-FloatingIPsAssociationNegativeTestJSON-1898080639 tempest-FloatingIPsAssociationNegativeTestJSON-1898080639-project] Took 0.45 seconds to select destinations for 1 instance(s). {{(pid=98843) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 13:41:28.106657 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-dcc968a8-53e3-4ced-b395-3a715d8a0561 tempest-FloatingIPsAssociationNegativeTestJSON-1898080639 tempest-FloatingIPsAssociationNegativeTestJSON-1898080639-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:41:28.107450 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-dcc968a8-53e3-4ced-b395-3a715d8a0561 tempest-FloatingIPsAssociationNegativeTestJSON-1898080639 tempest-FloatingIPsAssociationNegativeTestJSON-1898080639-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:41:28.246731 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-dcc968a8-53e3-4ced-b395-3a715d8a0561 tempest-FloatingIPsAssociationNegativeTestJSON-1898080639 tempest-FloatingIPsAssociationNegativeTestJSON-1898080639-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:41:28.249535 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-dcc968a8-53e3-4ced-b395-3a715d8a0561 tempest-FloatingIPsAssociationNegativeTestJSON-1898080639 tempest-FloatingIPsAssociationNegativeTestJSON-1898080639-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:41:28.251464 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-dcc968a8-53e3-4ced-b395-3a715d8a0561 tempest-FloatingIPsAssociationNegativeTestJSON-1898080639 tempest-FloatingIPsAssociationNegativeTestJSON-1898080639-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:41:28.252488 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-dcc968a8-53e3-4ced-b395-3a715d8a0561 tempest-FloatingIPsAssociationNegativeTestJSON-1898080639 tempest-FloatingIPsAssociationNegativeTestJSON-1898080639-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:41:28.289337 n-d-791503-6 nova-conductor[98843]: DEBUG nova.quota [None req-dcc968a8-53e3-4ced-b395-3a715d8a0561 tempest-FloatingIPsAssociationNegativeTestJSON-1898080639 tempest-FloatingIPsAssociationNegativeTestJSON-1898080639-project] Getting quotas for project fd03767bf3ed484b802a72f0f20bb5f7. Resources: {'cores', 'ram', 'instances'} {{(pid=98843) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 13:41:28.301408 n-d-791503-6 nova-conductor[98843]: DEBUG nova.quota [None req-dcc968a8-53e3-4ced-b395-3a715d8a0561 tempest-FloatingIPsAssociationNegativeTestJSON-1898080639 tempest-FloatingIPsAssociationNegativeTestJSON-1898080639-project] Getting quotas for user 50da548249c94a5ea957c08b91400658 and project fd03767bf3ed484b802a72f0f20bb5f7. Resources: {'cores', 'ram', 'instances'} {{(pid=98843) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 13:41:28.324441 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-dcc968a8-53e3-4ced-b395-3a715d8a0561 tempest-FloatingIPsAssociationNegativeTestJSON-1898080639 tempest-FloatingIPsAssociationNegativeTestJSON-1898080639-project] [instance: d10b94cc-8d55-47bb-8c1e-fb5fd412740d] Selected host: n-h2-791503-6; Selected node: n-h2-791503-6; Alternates: [('n-h1-791503-6', 'n-h1-791503-6')] {{(pid=98843) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 13:41:28.327046 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-dcc968a8-53e3-4ced-b395-3a715d8a0561 tempest-FloatingIPsAssociationNegativeTestJSON-1898080639 tempest-FloatingIPsAssociationNegativeTestJSON-1898080639-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:41:28.328274 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-dcc968a8-53e3-4ced-b395-3a715d8a0561 tempest-FloatingIPsAssociationNegativeTestJSON-1898080639 tempest-FloatingIPsAssociationNegativeTestJSON-1898080639-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:41:28.346261 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-dcc968a8-53e3-4ced-b395-3a715d8a0561 tempest-FloatingIPsAssociationNegativeTestJSON-1898080639 tempest-FloatingIPsAssociationNegativeTestJSON-1898080639-project] [instance: d10b94cc-8d55-47bb-8c1e-fb5fd412740d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='64f6036b-99a9-40e4-8963-3cdf66964954',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98843) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 13:41:28.352773 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-dcc968a8-53e3-4ced-b395-3a715d8a0561 tempest-FloatingIPsAssociationNegativeTestJSON-1898080639 tempest-FloatingIPsAssociationNegativeTestJSON-1898080639-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:41:28.355113 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-dcc968a8-53e3-4ced-b395-3a715d8a0561 tempest-FloatingIPsAssociationNegativeTestJSON-1898080639 tempest-FloatingIPsAssociationNegativeTestJSON-1898080639-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:41:28.436307 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-dcc968a8-53e3-4ced-b395-3a715d8a0561 tempest-FloatingIPsAssociationNegativeTestJSON-1898080639 tempest-FloatingIPsAssociationNegativeTestJSON-1898080639-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:41:28.438311 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-dcc968a8-53e3-4ced-b395-3a715d8a0561 tempest-FloatingIPsAssociationNegativeTestJSON-1898080639 tempest-FloatingIPsAssociationNegativeTestJSON-1898080639-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:41:34.332106 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.manager [None req-16f81467-fe30-4f00-b918-e1a46684a37b tempest-MigrationsAdminTest-1925540011 tempest-MigrationsAdminTest-1925540011-project-admin] Targeting cell b241212c-c279-4fbb-a1e7-b87889287cbf(cell1) for conductor method migrate_server {{(pid=98844) wrapper /opt/stack/nova/nova/conductor/manager.py:91}} May 28 13:41:34.332999 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-16f81467-fe30-4f00-b918-e1a46684a37b tempest-MigrationsAdminTest-1925540011 tempest-MigrationsAdminTest-1925540011-project-admin] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:41:34.333654 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-16f81467-fe30-4f00-b918-e1a46684a37b tempest-MigrationsAdminTest-1925540011 tempest-MigrationsAdminTest-1925540011-project-admin] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:41:35.408903 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.tasks.migrate [None req-16f81467-fe30-4f00-b918-e1a46684a37b tempest-MigrationsAdminTest-1925540011 tempest-MigrationsAdminTest-1925540011-project-admin] [instance: 3fa8f703-f364-4070-9625-67cabad30e71] Restricting to cell b241212c-c279-4fbb-a1e7-b87889287cbf(cell1) while migrating {{(pid=98844) _set_requested_destination_cell /opt/stack/nova/nova/conductor/tasks/migrate.py:208}} May 28 13:41:36.682866 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.tasks.migrate [None req-16f81467-fe30-4f00-b918-e1a46684a37b tempest-MigrationsAdminTest-1925540011 tempest-MigrationsAdminTest-1925540011-project-admin] Created allocations for migration 69177dd6-392f-44df-8b4a-e3c57d15abf8 on d4341c2e-3ff0-43f5-9b7e-4ec6191a47d4 {{(pid=98844) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} May 28 13:41:37.081612 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.tasks.migrate [None req-16f81467-fe30-4f00-b918-e1a46684a37b tempest-MigrationsAdminTest-1925540011 tempest-MigrationsAdminTest-1925540011-project-admin] [instance: 3fa8f703-f364-4070-9625-67cabad30e71] Calling prep_resize with selected host: n-h2-791503-6; Selected node: n-h2-791503-6; Alternates: [] {{(pid=98844) _execute /opt/stack/nova/nova/conductor/tasks/migrate.py:315}} May 28 13:41:37.998879 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-0ac17bc8-bf95-45b1-88d6-cd69b67ea65a tempest-ServersNegativeTestJSON-848961242 tempest-ServersNegativeTestJSON-848961242-project] Took 0.72 seconds to select destinations for 1 instance(s). {{(pid=98843) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 13:41:38.092453 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-0ac17bc8-bf95-45b1-88d6-cd69b67ea65a tempest-ServersNegativeTestJSON-848961242 tempest-ServersNegativeTestJSON-848961242-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:41:38.093146 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-0ac17bc8-bf95-45b1-88d6-cd69b67ea65a tempest-ServersNegativeTestJSON-848961242 tempest-ServersNegativeTestJSON-848961242-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:41:38.224942 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-0ac17bc8-bf95-45b1-88d6-cd69b67ea65a tempest-ServersNegativeTestJSON-848961242 tempest-ServersNegativeTestJSON-848961242-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:41:38.226666 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-0ac17bc8-bf95-45b1-88d6-cd69b67ea65a tempest-ServersNegativeTestJSON-848961242 tempest-ServersNegativeTestJSON-848961242-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:41:38.228700 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-0ac17bc8-bf95-45b1-88d6-cd69b67ea65a tempest-ServersNegativeTestJSON-848961242 tempest-ServersNegativeTestJSON-848961242-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:41:38.229689 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-0ac17bc8-bf95-45b1-88d6-cd69b67ea65a tempest-ServersNegativeTestJSON-848961242 tempest-ServersNegativeTestJSON-848961242-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:41:38.263609 n-d-791503-6 nova-conductor[98843]: DEBUG nova.quota [None req-0ac17bc8-bf95-45b1-88d6-cd69b67ea65a tempest-ServersNegativeTestJSON-848961242 tempest-ServersNegativeTestJSON-848961242-project] Getting quotas for project 3817dfafb60f4d3199f72eb2fd7cb3b4. Resources: {'cores', 'ram', 'instances'} {{(pid=98843) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 13:41:38.276678 n-d-791503-6 nova-conductor[98843]: DEBUG nova.quota [None req-0ac17bc8-bf95-45b1-88d6-cd69b67ea65a tempest-ServersNegativeTestJSON-848961242 tempest-ServersNegativeTestJSON-848961242-project] Getting quotas for user ef5ac584e7334508b42515488eb984be and project 3817dfafb60f4d3199f72eb2fd7cb3b4. Resources: {'cores', 'ram', 'instances'} {{(pid=98843) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 13:41:38.300491 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-0ac17bc8-bf95-45b1-88d6-cd69b67ea65a tempest-ServersNegativeTestJSON-848961242 tempest-ServersNegativeTestJSON-848961242-project] [instance: 0c46df53-17f4-4d4f-8c06-603f8cbffe69] Selected host: n-h1-791503-6; Selected node: n-h1-791503-6; Alternates: [('n-h2-791503-6', 'n-h2-791503-6')] {{(pid=98843) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 13:41:38.304027 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-0ac17bc8-bf95-45b1-88d6-cd69b67ea65a tempest-ServersNegativeTestJSON-848961242 tempest-ServersNegativeTestJSON-848961242-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:41:38.305089 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-0ac17bc8-bf95-45b1-88d6-cd69b67ea65a tempest-ServersNegativeTestJSON-848961242 tempest-ServersNegativeTestJSON-848961242-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:41:38.320631 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-0ac17bc8-bf95-45b1-88d6-cd69b67ea65a tempest-ServersNegativeTestJSON-848961242 tempest-ServersNegativeTestJSON-848961242-project] [instance: 0c46df53-17f4-4d4f-8c06-603f8cbffe69] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='64f6036b-99a9-40e4-8963-3cdf66964954',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98843) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 13:41:38.324283 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-0ac17bc8-bf95-45b1-88d6-cd69b67ea65a tempest-ServersNegativeTestJSON-848961242 tempest-ServersNegativeTestJSON-848961242-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:41:38.325273 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-0ac17bc8-bf95-45b1-88d6-cd69b67ea65a tempest-ServersNegativeTestJSON-848961242 tempest-ServersNegativeTestJSON-848961242-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:41:38.411835 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-0ac17bc8-bf95-45b1-88d6-cd69b67ea65a tempest-ServersNegativeTestJSON-848961242 tempest-ServersNegativeTestJSON-848961242-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:41:38.412646 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-0ac17bc8-bf95-45b1-88d6-cd69b67ea65a tempest-ServersNegativeTestJSON-848961242 tempest-ServersNegativeTestJSON-848961242-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:41:45.918787 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.manager [None req-ce81d59d-c897-412e-87af-8114b3aec209 tempest-ServersAdminTestJSON-1710467438 tempest-ServersAdminTestJSON-1710467438-project] Took 0.73 seconds to select destinations for 1 instance(s). {{(pid=98844) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 13:41:45.946515 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-ce81d59d-c897-412e-87af-8114b3aec209 tempest-ServersAdminTestJSON-1710467438 tempest-ServersAdminTestJSON-1710467438-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:41:45.947263 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-ce81d59d-c897-412e-87af-8114b3aec209 tempest-ServersAdminTestJSON-1710467438 tempest-ServersAdminTestJSON-1710467438-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:41:46.038700 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-ce81d59d-c897-412e-87af-8114b3aec209 tempest-ServersAdminTestJSON-1710467438 tempest-ServersAdminTestJSON-1710467438-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:41:46.039308 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-ce81d59d-c897-412e-87af-8114b3aec209 tempest-ServersAdminTestJSON-1710467438 tempest-ServersAdminTestJSON-1710467438-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:41:46.040315 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-ce81d59d-c897-412e-87af-8114b3aec209 tempest-ServersAdminTestJSON-1710467438 tempest-ServersAdminTestJSON-1710467438-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:41:46.040701 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-ce81d59d-c897-412e-87af-8114b3aec209 tempest-ServersAdminTestJSON-1710467438 tempest-ServersAdminTestJSON-1710467438-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:41:46.066161 n-d-791503-6 nova-conductor[98844]: DEBUG nova.quota [None req-ce81d59d-c897-412e-87af-8114b3aec209 tempest-ServersAdminTestJSON-1710467438 tempest-ServersAdminTestJSON-1710467438-project] Getting quotas for project 0456375631d74feaa1d8bc3825e90159. Resources: {'cores', 'ram', 'instances'} {{(pid=98844) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 13:41:46.080854 n-d-791503-6 nova-conductor[98844]: DEBUG nova.quota [None req-ce81d59d-c897-412e-87af-8114b3aec209 tempest-ServersAdminTestJSON-1710467438 tempest-ServersAdminTestJSON-1710467438-project] Getting quotas for user 1e6c6909ff8d491ea276b4ebf3128e47 and project 0456375631d74feaa1d8bc3825e90159. Resources: {'cores', 'ram', 'instances'} {{(pid=98844) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 13:41:46.102168 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.manager [None req-ce81d59d-c897-412e-87af-8114b3aec209 tempest-ServersAdminTestJSON-1710467438 tempest-ServersAdminTestJSON-1710467438-project] [instance: b12277b0-847b-486b-b42c-c89448d03757] Selected host: n-h2-791503-6; Selected node: n-h2-791503-6; Alternates: [('n-h1-791503-6', 'n-h1-791503-6')] {{(pid=98844) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 13:41:46.103994 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-ce81d59d-c897-412e-87af-8114b3aec209 tempest-ServersAdminTestJSON-1710467438 tempest-ServersAdminTestJSON-1710467438-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:41:46.104583 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-ce81d59d-c897-412e-87af-8114b3aec209 tempest-ServersAdminTestJSON-1710467438 tempest-ServersAdminTestJSON-1710467438-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:41:46.119416 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.manager [None req-ce81d59d-c897-412e-87af-8114b3aec209 tempest-ServersAdminTestJSON-1710467438 tempest-ServersAdminTestJSON-1710467438-project] [instance: b12277b0-847b-486b-b42c-c89448d03757] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='64f6036b-99a9-40e4-8963-3cdf66964954',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98844) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 13:41:46.122245 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-ce81d59d-c897-412e-87af-8114b3aec209 tempest-ServersAdminTestJSON-1710467438 tempest-ServersAdminTestJSON-1710467438-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:41:46.123451 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-ce81d59d-c897-412e-87af-8114b3aec209 tempest-ServersAdminTestJSON-1710467438 tempest-ServersAdminTestJSON-1710467438-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:41:46.181490 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-ce81d59d-c897-412e-87af-8114b3aec209 tempest-ServersAdminTestJSON-1710467438 tempest-ServersAdminTestJSON-1710467438-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:41:46.182566 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-ce81d59d-c897-412e-87af-8114b3aec209 tempest-ServersAdminTestJSON-1710467438 tempest-ServersAdminTestJSON-1710467438-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:41:47.955455 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-a67f1f30-78f3-4314-9701-be5f544fa78a tempest-ServersAdminTestJSON-1710467438 tempest-ServersAdminTestJSON-1710467438-project] Took 0.60 seconds to select destinations for 1 instance(s). {{(pid=98843) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 13:41:48.015482 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-a67f1f30-78f3-4314-9701-be5f544fa78a tempest-ServersAdminTestJSON-1710467438 tempest-ServersAdminTestJSON-1710467438-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:41:48.016175 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-a67f1f30-78f3-4314-9701-be5f544fa78a tempest-ServersAdminTestJSON-1710467438 tempest-ServersAdminTestJSON-1710467438-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:41:48.113936 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-a67f1f30-78f3-4314-9701-be5f544fa78a tempest-ServersAdminTestJSON-1710467438 tempest-ServersAdminTestJSON-1710467438-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:41:48.115496 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-a67f1f30-78f3-4314-9701-be5f544fa78a tempest-ServersAdminTestJSON-1710467438 tempest-ServersAdminTestJSON-1710467438-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:41:48.116764 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-a67f1f30-78f3-4314-9701-be5f544fa78a tempest-ServersAdminTestJSON-1710467438 tempest-ServersAdminTestJSON-1710467438-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:41:48.117607 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-a67f1f30-78f3-4314-9701-be5f544fa78a tempest-ServersAdminTestJSON-1710467438 tempest-ServersAdminTestJSON-1710467438-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:41:48.180809 n-d-791503-6 nova-conductor[98843]: DEBUG nova.quota [None req-a67f1f30-78f3-4314-9701-be5f544fa78a tempest-ServersAdminTestJSON-1710467438 tempest-ServersAdminTestJSON-1710467438-project] Getting quotas for project 0456375631d74feaa1d8bc3825e90159. Resources: {'cores', 'ram', 'instances'} {{(pid=98843) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 13:41:48.213723 n-d-791503-6 nova-conductor[98843]: DEBUG nova.quota [None req-a67f1f30-78f3-4314-9701-be5f544fa78a tempest-ServersAdminTestJSON-1710467438 tempest-ServersAdminTestJSON-1710467438-project] Getting quotas for user 1e6c6909ff8d491ea276b4ebf3128e47 and project 0456375631d74feaa1d8bc3825e90159. Resources: {'cores', 'ram', 'instances'} {{(pid=98843) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 13:41:48.255573 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-a67f1f30-78f3-4314-9701-be5f544fa78a tempest-ServersAdminTestJSON-1710467438 tempest-ServersAdminTestJSON-1710467438-project] [instance: 9a6a8b89-aa66-4759-a043-a07cd40807c4] Selected host: n-h1-791503-6; Selected node: n-h1-791503-6; Alternates: [('n-h2-791503-6', 'n-h2-791503-6')] {{(pid=98843) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 13:41:48.256922 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-a67f1f30-78f3-4314-9701-be5f544fa78a tempest-ServersAdminTestJSON-1710467438 tempest-ServersAdminTestJSON-1710467438-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:41:48.257571 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-a67f1f30-78f3-4314-9701-be5f544fa78a tempest-ServersAdminTestJSON-1710467438 tempest-ServersAdminTestJSON-1710467438-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:41:48.270598 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-a67f1f30-78f3-4314-9701-be5f544fa78a tempest-ServersAdminTestJSON-1710467438 tempest-ServersAdminTestJSON-1710467438-project] [instance: 9a6a8b89-aa66-4759-a043-a07cd40807c4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='64f6036b-99a9-40e4-8963-3cdf66964954',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98843) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 13:41:48.274732 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-a67f1f30-78f3-4314-9701-be5f544fa78a tempest-ServersAdminTestJSON-1710467438 tempest-ServersAdminTestJSON-1710467438-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:41:48.276011 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-a67f1f30-78f3-4314-9701-be5f544fa78a tempest-ServersAdminTestJSON-1710467438 tempest-ServersAdminTestJSON-1710467438-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:41:48.372020 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-a67f1f30-78f3-4314-9701-be5f544fa78a tempest-ServersAdminTestJSON-1710467438 tempest-ServersAdminTestJSON-1710467438-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:41:48.372462 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-a67f1f30-78f3-4314-9701-be5f544fa78a tempest-ServersAdminTestJSON-1710467438 tempest-ServersAdminTestJSON-1710467438-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:41:59.168996 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.manager [None req-c39259da-0f19-4061-aefc-efe1082354e5 tempest-ListImageFiltersTestJSON-851786763 tempest-ListImageFiltersTestJSON-851786763-project] Took 0.57 seconds to select destinations for 1 instance(s). {{(pid=98844) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 13:41:59.215657 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-c39259da-0f19-4061-aefc-efe1082354e5 tempest-ListImageFiltersTestJSON-851786763 tempest-ListImageFiltersTestJSON-851786763-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:41:59.217553 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-c39259da-0f19-4061-aefc-efe1082354e5 tempest-ListImageFiltersTestJSON-851786763 tempest-ListImageFiltersTestJSON-851786763-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:41:59.330146 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-c39259da-0f19-4061-aefc-efe1082354e5 tempest-ListImageFiltersTestJSON-851786763 tempest-ListImageFiltersTestJSON-851786763-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:41:59.331143 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-c39259da-0f19-4061-aefc-efe1082354e5 tempest-ListImageFiltersTestJSON-851786763 tempest-ListImageFiltersTestJSON-851786763-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:41:59.332591 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-c39259da-0f19-4061-aefc-efe1082354e5 tempest-ListImageFiltersTestJSON-851786763 tempest-ListImageFiltersTestJSON-851786763-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:41:59.333676 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-c39259da-0f19-4061-aefc-efe1082354e5 tempest-ListImageFiltersTestJSON-851786763 tempest-ListImageFiltersTestJSON-851786763-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:41:59.383743 n-d-791503-6 nova-conductor[98844]: DEBUG nova.quota [None req-c39259da-0f19-4061-aefc-efe1082354e5 tempest-ListImageFiltersTestJSON-851786763 tempest-ListImageFiltersTestJSON-851786763-project] Getting quotas for project 56141fdcbf474832a5a82a7737eb49a5. Resources: {'cores', 'ram', 'instances'} {{(pid=98844) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 13:41:59.396787 n-d-791503-6 nova-conductor[98844]: DEBUG nova.quota [None req-c39259da-0f19-4061-aefc-efe1082354e5 tempest-ListImageFiltersTestJSON-851786763 tempest-ListImageFiltersTestJSON-851786763-project] Getting quotas for user 48573da9426e422bb459e7709cb0c247 and project 56141fdcbf474832a5a82a7737eb49a5. Resources: {'cores', 'ram', 'instances'} {{(pid=98844) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 13:41:59.421084 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.manager [None req-c39259da-0f19-4061-aefc-efe1082354e5 tempest-ListImageFiltersTestJSON-851786763 tempest-ListImageFiltersTestJSON-851786763-project] [instance: 304b6d66-ce2e-4131-aa08-4cb8a3ec6f52] Selected host: n-h2-791503-6; Selected node: n-h2-791503-6; Alternates: [('n-h1-791503-6', 'n-h1-791503-6')] {{(pid=98844) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 13:41:59.422135 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-c39259da-0f19-4061-aefc-efe1082354e5 tempest-ListImageFiltersTestJSON-851786763 tempest-ListImageFiltersTestJSON-851786763-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:41:59.422523 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-c39259da-0f19-4061-aefc-efe1082354e5 tempest-ListImageFiltersTestJSON-851786763 tempest-ListImageFiltersTestJSON-851786763-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:41:59.435297 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.manager [None req-c39259da-0f19-4061-aefc-efe1082354e5 tempest-ListImageFiltersTestJSON-851786763 tempest-ListImageFiltersTestJSON-851786763-project] [instance: 304b6d66-ce2e-4131-aa08-4cb8a3ec6f52] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='64f6036b-99a9-40e4-8963-3cdf66964954',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98844) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 13:41:59.436751 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-c39259da-0f19-4061-aefc-efe1082354e5 tempest-ListImageFiltersTestJSON-851786763 tempest-ListImageFiltersTestJSON-851786763-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:41:59.437528 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-c39259da-0f19-4061-aefc-efe1082354e5 tempest-ListImageFiltersTestJSON-851786763 tempest-ListImageFiltersTestJSON-851786763-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:41:59.510602 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-c39259da-0f19-4061-aefc-efe1082354e5 tempest-ListImageFiltersTestJSON-851786763 tempest-ListImageFiltersTestJSON-851786763-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:41:59.511002 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-c39259da-0f19-4061-aefc-efe1082354e5 tempest-ListImageFiltersTestJSON-851786763 tempest-ListImageFiltersTestJSON-851786763-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:42:01.366368 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-195931ae-b543-46d5-b755-0db74e348c3b tempest-ServersAdminNegativeTestJSON-1572238662 tempest-ServersAdminNegativeTestJSON-1572238662-project] Took 0.56 seconds to select destinations for 1 instance(s). {{(pid=98843) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 13:42:01.402273 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-195931ae-b543-46d5-b755-0db74e348c3b tempest-ServersAdminNegativeTestJSON-1572238662 tempest-ServersAdminNegativeTestJSON-1572238662-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:42:01.403528 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-195931ae-b543-46d5-b755-0db74e348c3b tempest-ServersAdminNegativeTestJSON-1572238662 tempest-ServersAdminNegativeTestJSON-1572238662-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:42:01.482855 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-195931ae-b543-46d5-b755-0db74e348c3b tempest-ServersAdminNegativeTestJSON-1572238662 tempest-ServersAdminNegativeTestJSON-1572238662-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:42:01.483445 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-195931ae-b543-46d5-b755-0db74e348c3b tempest-ServersAdminNegativeTestJSON-1572238662 tempest-ServersAdminNegativeTestJSON-1572238662-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:42:01.484282 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-195931ae-b543-46d5-b755-0db74e348c3b tempest-ServersAdminNegativeTestJSON-1572238662 tempest-ServersAdminNegativeTestJSON-1572238662-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:42:01.484798 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-195931ae-b543-46d5-b755-0db74e348c3b tempest-ServersAdminNegativeTestJSON-1572238662 tempest-ServersAdminNegativeTestJSON-1572238662-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:42:01.504893 n-d-791503-6 nova-conductor[98843]: DEBUG nova.quota [None req-195931ae-b543-46d5-b755-0db74e348c3b tempest-ServersAdminNegativeTestJSON-1572238662 tempest-ServersAdminNegativeTestJSON-1572238662-project] Getting quotas for project b96d003ce66a40479264a446f79ee9c0. Resources: {'cores', 'ram', 'instances'} {{(pid=98843) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 13:42:01.513030 n-d-791503-6 nova-conductor[98843]: DEBUG nova.quota [None req-195931ae-b543-46d5-b755-0db74e348c3b tempest-ServersAdminNegativeTestJSON-1572238662 tempest-ServersAdminNegativeTestJSON-1572238662-project] Getting quotas for user 3bcbd62c832e432db33612bfa4e81d0f and project b96d003ce66a40479264a446f79ee9c0. Resources: {'cores', 'ram', 'instances'} {{(pid=98843) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 13:42:01.528890 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-195931ae-b543-46d5-b755-0db74e348c3b tempest-ServersAdminNegativeTestJSON-1572238662 tempest-ServersAdminNegativeTestJSON-1572238662-project] [instance: 14cf7771-b2e4-49e4-9d6e-04c43688a875] Selected host: n-h1-791503-6; Selected node: n-h1-791503-6; Alternates: [('n-h2-791503-6', 'n-h2-791503-6')] {{(pid=98843) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 13:42:01.530457 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-195931ae-b543-46d5-b755-0db74e348c3b tempest-ServersAdminNegativeTestJSON-1572238662 tempest-ServersAdminNegativeTestJSON-1572238662-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:42:01.531037 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-195931ae-b543-46d5-b755-0db74e348c3b tempest-ServersAdminNegativeTestJSON-1572238662 tempest-ServersAdminNegativeTestJSON-1572238662-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:42:01.540054 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-195931ae-b543-46d5-b755-0db74e348c3b tempest-ServersAdminNegativeTestJSON-1572238662 tempest-ServersAdminNegativeTestJSON-1572238662-project] [instance: 14cf7771-b2e4-49e4-9d6e-04c43688a875] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='64f6036b-99a9-40e4-8963-3cdf66964954',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98843) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 13:42:01.541560 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-195931ae-b543-46d5-b755-0db74e348c3b tempest-ServersAdminNegativeTestJSON-1572238662 tempest-ServersAdminNegativeTestJSON-1572238662-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:42:01.542078 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-195931ae-b543-46d5-b755-0db74e348c3b tempest-ServersAdminNegativeTestJSON-1572238662 tempest-ServersAdminNegativeTestJSON-1572238662-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:42:01.586992 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-195931ae-b543-46d5-b755-0db74e348c3b tempest-ServersAdminNegativeTestJSON-1572238662 tempest-ServersAdminNegativeTestJSON-1572238662-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:42:01.587533 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-195931ae-b543-46d5-b755-0db74e348c3b tempest-ServersAdminNegativeTestJSON-1572238662 tempest-ServersAdminNegativeTestJSON-1572238662-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:42:05.759886 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.manager [None req-5cc5e325-cd5d-4722-a98e-55a6e33f534c tempest-ListImageFiltersTestJSON-851786763 tempest-ListImageFiltersTestJSON-851786763-project] Took 0.55 seconds to select destinations for 1 instance(s). {{(pid=98844) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 13:42:05.862875 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-5cc5e325-cd5d-4722-a98e-55a6e33f534c tempest-ListImageFiltersTestJSON-851786763 tempest-ListImageFiltersTestJSON-851786763-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:42:05.863780 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-5cc5e325-cd5d-4722-a98e-55a6e33f534c tempest-ListImageFiltersTestJSON-851786763 tempest-ListImageFiltersTestJSON-851786763-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:42:05.939367 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-5cc5e325-cd5d-4722-a98e-55a6e33f534c tempest-ListImageFiltersTestJSON-851786763 tempest-ListImageFiltersTestJSON-851786763-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:42:05.940107 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-5cc5e325-cd5d-4722-a98e-55a6e33f534c tempest-ListImageFiltersTestJSON-851786763 tempest-ListImageFiltersTestJSON-851786763-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:42:05.941116 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-5cc5e325-cd5d-4722-a98e-55a6e33f534c tempest-ListImageFiltersTestJSON-851786763 tempest-ListImageFiltersTestJSON-851786763-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:42:05.941695 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-5cc5e325-cd5d-4722-a98e-55a6e33f534c tempest-ListImageFiltersTestJSON-851786763 tempest-ListImageFiltersTestJSON-851786763-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:42:05.971793 n-d-791503-6 nova-conductor[98844]: DEBUG nova.quota [None req-5cc5e325-cd5d-4722-a98e-55a6e33f534c tempest-ListImageFiltersTestJSON-851786763 tempest-ListImageFiltersTestJSON-851786763-project] Getting quotas for project 56141fdcbf474832a5a82a7737eb49a5. Resources: {'cores', 'ram', 'instances'} {{(pid=98844) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 13:42:05.979165 n-d-791503-6 nova-conductor[98844]: DEBUG nova.quota [None req-5cc5e325-cd5d-4722-a98e-55a6e33f534c tempest-ListImageFiltersTestJSON-851786763 tempest-ListImageFiltersTestJSON-851786763-project] Getting quotas for user 48573da9426e422bb459e7709cb0c247 and project 56141fdcbf474832a5a82a7737eb49a5. Resources: {'cores', 'ram', 'instances'} {{(pid=98844) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 13:42:06.011429 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.manager [None req-5cc5e325-cd5d-4722-a98e-55a6e33f534c tempest-ListImageFiltersTestJSON-851786763 tempest-ListImageFiltersTestJSON-851786763-project] [instance: cdb52d29-528b-4a3c-989a-bbb41144ac22] Selected host: n-h2-791503-6; Selected node: n-h2-791503-6; Alternates: [('n-h1-791503-6', 'n-h1-791503-6')] {{(pid=98844) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 13:42:06.013300 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-5cc5e325-cd5d-4722-a98e-55a6e33f534c tempest-ListImageFiltersTestJSON-851786763 tempest-ListImageFiltersTestJSON-851786763-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:42:06.014216 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-5cc5e325-cd5d-4722-a98e-55a6e33f534c tempest-ListImageFiltersTestJSON-851786763 tempest-ListImageFiltersTestJSON-851786763-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:42:06.042534 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.manager [None req-5cc5e325-cd5d-4722-a98e-55a6e33f534c tempest-ListImageFiltersTestJSON-851786763 tempest-ListImageFiltersTestJSON-851786763-project] [instance: cdb52d29-528b-4a3c-989a-bbb41144ac22] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='64f6036b-99a9-40e4-8963-3cdf66964954',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98844) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 13:42:06.050455 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-5cc5e325-cd5d-4722-a98e-55a6e33f534c tempest-ListImageFiltersTestJSON-851786763 tempest-ListImageFiltersTestJSON-851786763-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:42:06.051648 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-5cc5e325-cd5d-4722-a98e-55a6e33f534c tempest-ListImageFiltersTestJSON-851786763 tempest-ListImageFiltersTestJSON-851786763-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:42:06.162324 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-5cc5e325-cd5d-4722-a98e-55a6e33f534c tempest-ListImageFiltersTestJSON-851786763 tempest-ListImageFiltersTestJSON-851786763-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:42:06.163781 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-5cc5e325-cd5d-4722-a98e-55a6e33f534c tempest-ListImageFiltersTestJSON-851786763 tempest-ListImageFiltersTestJSON-851786763-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:42:17.807669 n-d-791503-6 nova-conductor[98843]: ERROR oslo.messaging._drivers.impl_rabbit [-] [fb67aa64-250d-4c34-b696-14a5dd0b49b6] AMQP server on 10.222.0.68:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 28 13:42:18.836962 n-d-791503-6 nova-conductor[98843]: INFO oslo.messaging._drivers.impl_rabbit [-] [fb67aa64-250d-4c34-b696-14a5dd0b49b6] Reconnected to AMQP server on 10.222.0.68:5672 via [amqp] client with port 59146. May 28 13:42:28.764118 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-db6e7d50-f846-40c4-b183-913196a01f21 tempest-ServersAdminTestJSON-1710467438 tempest-ServersAdminTestJSON-1710467438-project] Took 0.39 seconds to select destinations for 1 instance(s). {{(pid=98843) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 13:42:28.822350 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-db6e7d50-f846-40c4-b183-913196a01f21 tempest-ServersAdminTestJSON-1710467438 tempest-ServersAdminTestJSON-1710467438-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:42:28.823048 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-db6e7d50-f846-40c4-b183-913196a01f21 tempest-ServersAdminTestJSON-1710467438 tempest-ServersAdminTestJSON-1710467438-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:42:28.904646 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-db6e7d50-f846-40c4-b183-913196a01f21 tempest-ServersAdminTestJSON-1710467438 tempest-ServersAdminTestJSON-1710467438-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:42:28.905469 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-db6e7d50-f846-40c4-b183-913196a01f21 tempest-ServersAdminTestJSON-1710467438 tempest-ServersAdminTestJSON-1710467438-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:42:28.906739 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-db6e7d50-f846-40c4-b183-913196a01f21 tempest-ServersAdminTestJSON-1710467438 tempest-ServersAdminTestJSON-1710467438-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:42:28.907264 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-db6e7d50-f846-40c4-b183-913196a01f21 tempest-ServersAdminTestJSON-1710467438 tempest-ServersAdminTestJSON-1710467438-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:42:28.931033 n-d-791503-6 nova-conductor[98843]: DEBUG nova.quota [None req-db6e7d50-f846-40c4-b183-913196a01f21 tempest-ServersAdminTestJSON-1710467438 tempest-ServersAdminTestJSON-1710467438-project] Getting quotas for project 0456375631d74feaa1d8bc3825e90159. Resources: {'cores', 'ram', 'instances'} {{(pid=98843) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 13:42:28.937505 n-d-791503-6 nova-conductor[98843]: DEBUG nova.quota [None req-db6e7d50-f846-40c4-b183-913196a01f21 tempest-ServersAdminTestJSON-1710467438 tempest-ServersAdminTestJSON-1710467438-project] Getting quotas for user 1e6c6909ff8d491ea276b4ebf3128e47 and project 0456375631d74feaa1d8bc3825e90159. Resources: {'cores', 'ram', 'instances'} {{(pid=98843) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 13:42:28.977937 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-db6e7d50-f846-40c4-b183-913196a01f21 tempest-ServersAdminTestJSON-1710467438 tempest-ServersAdminTestJSON-1710467438-project] [instance: 54516f3c-a15f-4024-8608-5bf5f92e5ed2] Selected host: n-h2-791503-6; Selected node: n-h2-791503-6; Alternates: [] {{(pid=98843) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 13:42:28.980053 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-db6e7d50-f846-40c4-b183-913196a01f21 tempest-ServersAdminTestJSON-1710467438 tempest-ServersAdminTestJSON-1710467438-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:42:28.981144 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-db6e7d50-f846-40c4-b183-913196a01f21 tempest-ServersAdminTestJSON-1710467438 tempest-ServersAdminTestJSON-1710467438-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:42:29.013566 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-db6e7d50-f846-40c4-b183-913196a01f21 tempest-ServersAdminTestJSON-1710467438 tempest-ServersAdminTestJSON-1710467438-project] [instance: 54516f3c-a15f-4024-8608-5bf5f92e5ed2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='64f6036b-99a9-40e4-8963-3cdf66964954',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98843) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 13:42:29.015271 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-db6e7d50-f846-40c4-b183-913196a01f21 tempest-ServersAdminTestJSON-1710467438 tempest-ServersAdminTestJSON-1710467438-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:42:29.015777 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-db6e7d50-f846-40c4-b183-913196a01f21 tempest-ServersAdminTestJSON-1710467438 tempest-ServersAdminTestJSON-1710467438-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:42:29.063272 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-db6e7d50-f846-40c4-b183-913196a01f21 tempest-ServersAdminTestJSON-1710467438 tempest-ServersAdminTestJSON-1710467438-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:42:29.063749 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-db6e7d50-f846-40c4-b183-913196a01f21 tempest-ServersAdminTestJSON-1710467438 tempest-ServersAdminTestJSON-1710467438-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:42:34.430671 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.manager [None req-25df9106-2af2-44fa-814f-1afb33f46ef0 tempest-MigrationsAdminTest-1666574026 tempest-MigrationsAdminTest-1666574026-project] Took 0.61 seconds to select destinations for 1 instance(s). {{(pid=98844) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 13:42:34.494369 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-25df9106-2af2-44fa-814f-1afb33f46ef0 tempest-MigrationsAdminTest-1666574026 tempest-MigrationsAdminTest-1666574026-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:42:34.495110 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-25df9106-2af2-44fa-814f-1afb33f46ef0 tempest-MigrationsAdminTest-1666574026 tempest-MigrationsAdminTest-1666574026-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:42:34.606730 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-25df9106-2af2-44fa-814f-1afb33f46ef0 tempest-MigrationsAdminTest-1666574026 tempest-MigrationsAdminTest-1666574026-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:42:34.607711 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-25df9106-2af2-44fa-814f-1afb33f46ef0 tempest-MigrationsAdminTest-1666574026 tempest-MigrationsAdminTest-1666574026-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:42:34.609602 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-25df9106-2af2-44fa-814f-1afb33f46ef0 tempest-MigrationsAdminTest-1666574026 tempest-MigrationsAdminTest-1666574026-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:42:34.610590 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-25df9106-2af2-44fa-814f-1afb33f46ef0 tempest-MigrationsAdminTest-1666574026 tempest-MigrationsAdminTest-1666574026-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:42:34.643860 n-d-791503-6 nova-conductor[98844]: DEBUG nova.quota [None req-25df9106-2af2-44fa-814f-1afb33f46ef0 tempest-MigrationsAdminTest-1666574026 tempest-MigrationsAdminTest-1666574026-project] Getting quotas for project 1df09ab4f06c415fb230001e945a2e55. Resources: {'cores', 'ram', 'instances'} {{(pid=98844) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 13:42:34.653758 n-d-791503-6 nova-conductor[98844]: DEBUG nova.quota [None req-25df9106-2af2-44fa-814f-1afb33f46ef0 tempest-MigrationsAdminTest-1666574026 tempest-MigrationsAdminTest-1666574026-project] Getting quotas for user 18b64baf715545358827a2c540135008 and project 1df09ab4f06c415fb230001e945a2e55. Resources: {'cores', 'ram', 'instances'} {{(pid=98844) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 13:42:34.676839 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.manager [None req-25df9106-2af2-44fa-814f-1afb33f46ef0 tempest-MigrationsAdminTest-1666574026 tempest-MigrationsAdminTest-1666574026-project] [instance: 4934f57e-c848-4b13-a429-8b8b9b39744d] Selected host: n-h1-791503-6; Selected node: n-h1-791503-6; Alternates: [('n-h2-791503-6', 'n-h2-791503-6')] {{(pid=98844) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 13:42:34.678956 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-25df9106-2af2-44fa-814f-1afb33f46ef0 tempest-MigrationsAdminTest-1666574026 tempest-MigrationsAdminTest-1666574026-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:42:34.679995 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-25df9106-2af2-44fa-814f-1afb33f46ef0 tempest-MigrationsAdminTest-1666574026 tempest-MigrationsAdminTest-1666574026-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:42:34.692444 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.manager [None req-25df9106-2af2-44fa-814f-1afb33f46ef0 tempest-MigrationsAdminTest-1666574026 tempest-MigrationsAdminTest-1666574026-project] [instance: 4934f57e-c848-4b13-a429-8b8b9b39744d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='64f6036b-99a9-40e4-8963-3cdf66964954',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98844) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 13:42:34.695169 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-25df9106-2af2-44fa-814f-1afb33f46ef0 tempest-MigrationsAdminTest-1666574026 tempest-MigrationsAdminTest-1666574026-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:42:34.695897 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-25df9106-2af2-44fa-814f-1afb33f46ef0 tempest-MigrationsAdminTest-1666574026 tempest-MigrationsAdminTest-1666574026-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:42:34.748787 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-25df9106-2af2-44fa-814f-1afb33f46ef0 tempest-MigrationsAdminTest-1666574026 tempest-MigrationsAdminTest-1666574026-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:42:34.749449 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-25df9106-2af2-44fa-814f-1afb33f46ef0 tempest-MigrationsAdminTest-1666574026 tempest-MigrationsAdminTest-1666574026-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:42:35.552556 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-72df6375-48a8-42ee-904b-4aebf3152587 tempest-ServersAdminNegativeTestJSON-1572238662 tempest-ServersAdminNegativeTestJSON-1572238662-project] Took 0.34 seconds to select destinations for 1 instance(s). {{(pid=98843) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 13:42:35.582077 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-72df6375-48a8-42ee-904b-4aebf3152587 tempest-ServersAdminNegativeTestJSON-1572238662 tempest-ServersAdminNegativeTestJSON-1572238662-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:42:35.582733 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-72df6375-48a8-42ee-904b-4aebf3152587 tempest-ServersAdminNegativeTestJSON-1572238662 tempest-ServersAdminNegativeTestJSON-1572238662-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:42:35.653813 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-72df6375-48a8-42ee-904b-4aebf3152587 tempest-ServersAdminNegativeTestJSON-1572238662 tempest-ServersAdminNegativeTestJSON-1572238662-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:42:35.654283 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-72df6375-48a8-42ee-904b-4aebf3152587 tempest-ServersAdminNegativeTestJSON-1572238662 tempest-ServersAdminNegativeTestJSON-1572238662-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:42:35.655198 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-72df6375-48a8-42ee-904b-4aebf3152587 tempest-ServersAdminNegativeTestJSON-1572238662 tempest-ServersAdminNegativeTestJSON-1572238662-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:42:35.656011 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-72df6375-48a8-42ee-904b-4aebf3152587 tempest-ServersAdminNegativeTestJSON-1572238662 tempest-ServersAdminNegativeTestJSON-1572238662-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:42:35.681634 n-d-791503-6 nova-conductor[98843]: DEBUG nova.quota [None req-72df6375-48a8-42ee-904b-4aebf3152587 tempest-ServersAdminNegativeTestJSON-1572238662 tempest-ServersAdminNegativeTestJSON-1572238662-project] Getting quotas for project b96d003ce66a40479264a446f79ee9c0. Resources: {'cores', 'ram', 'instances'} {{(pid=98843) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 13:42:35.694655 n-d-791503-6 nova-conductor[98843]: DEBUG nova.quota [None req-72df6375-48a8-42ee-904b-4aebf3152587 tempest-ServersAdminNegativeTestJSON-1572238662 tempest-ServersAdminNegativeTestJSON-1572238662-project] Getting quotas for user 3bcbd62c832e432db33612bfa4e81d0f and project b96d003ce66a40479264a446f79ee9c0. Resources: {'cores', 'ram', 'instances'} {{(pid=98843) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 13:42:35.715896 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-72df6375-48a8-42ee-904b-4aebf3152587 tempest-ServersAdminNegativeTestJSON-1572238662 tempest-ServersAdminNegativeTestJSON-1572238662-project] [instance: dcea7502-75a0-46cc-bf79-a96008b609dd] Selected host: n-h1-791503-6; Selected node: n-h1-791503-6; Alternates: [('n-h2-791503-6', 'n-h2-791503-6')] {{(pid=98843) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 13:42:35.717145 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-72df6375-48a8-42ee-904b-4aebf3152587 tempest-ServersAdminNegativeTestJSON-1572238662 tempest-ServersAdminNegativeTestJSON-1572238662-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:42:35.717857 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-72df6375-48a8-42ee-904b-4aebf3152587 tempest-ServersAdminNegativeTestJSON-1572238662 tempest-ServersAdminNegativeTestJSON-1572238662-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:42:35.727343 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-72df6375-48a8-42ee-904b-4aebf3152587 tempest-ServersAdminNegativeTestJSON-1572238662 tempest-ServersAdminNegativeTestJSON-1572238662-project] [instance: dcea7502-75a0-46cc-bf79-a96008b609dd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='64f6036b-99a9-40e4-8963-3cdf66964954',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98843) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 13:42:35.729279 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-72df6375-48a8-42ee-904b-4aebf3152587 tempest-ServersAdminNegativeTestJSON-1572238662 tempest-ServersAdminNegativeTestJSON-1572238662-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:42:35.729714 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-72df6375-48a8-42ee-904b-4aebf3152587 tempest-ServersAdminNegativeTestJSON-1572238662 tempest-ServersAdminNegativeTestJSON-1572238662-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:42:35.772354 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-72df6375-48a8-42ee-904b-4aebf3152587 tempest-ServersAdminNegativeTestJSON-1572238662 tempest-ServersAdminNegativeTestJSON-1572238662-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:42:35.772945 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-72df6375-48a8-42ee-904b-4aebf3152587 tempest-ServersAdminNegativeTestJSON-1572238662 tempest-ServersAdminNegativeTestJSON-1572238662-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:42:41.535604 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.manager [None req-945db856-d45e-4429-a4f0-01f42d875f56 tempest-InstanceActionsV221TestJSON-315468484 tempest-InstanceActionsV221TestJSON-315468484-project] Took 0.38 seconds to select destinations for 1 instance(s). {{(pid=98844) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 13:42:41.576420 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-945db856-d45e-4429-a4f0-01f42d875f56 tempest-InstanceActionsV221TestJSON-315468484 tempest-InstanceActionsV221TestJSON-315468484-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:42:41.577060 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-945db856-d45e-4429-a4f0-01f42d875f56 tempest-InstanceActionsV221TestJSON-315468484 tempest-InstanceActionsV221TestJSON-315468484-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:42:41.688693 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-945db856-d45e-4429-a4f0-01f42d875f56 tempest-InstanceActionsV221TestJSON-315468484 tempest-InstanceActionsV221TestJSON-315468484-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:42:41.689961 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-945db856-d45e-4429-a4f0-01f42d875f56 tempest-InstanceActionsV221TestJSON-315468484 tempest-InstanceActionsV221TestJSON-315468484-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:42:41.692616 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-945db856-d45e-4429-a4f0-01f42d875f56 tempest-InstanceActionsV221TestJSON-315468484 tempest-InstanceActionsV221TestJSON-315468484-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:42:41.693440 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-945db856-d45e-4429-a4f0-01f42d875f56 tempest-InstanceActionsV221TestJSON-315468484 tempest-InstanceActionsV221TestJSON-315468484-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:42:41.727864 n-d-791503-6 nova-conductor[98844]: DEBUG nova.quota [None req-945db856-d45e-4429-a4f0-01f42d875f56 tempest-InstanceActionsV221TestJSON-315468484 tempest-InstanceActionsV221TestJSON-315468484-project] Getting quotas for project ffb7ac478c7a4eaab8266747de13eda0. Resources: {'cores', 'ram', 'instances'} {{(pid=98844) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 13:42:41.737894 n-d-791503-6 nova-conductor[98844]: DEBUG nova.quota [None req-945db856-d45e-4429-a4f0-01f42d875f56 tempest-InstanceActionsV221TestJSON-315468484 tempest-InstanceActionsV221TestJSON-315468484-project] Getting quotas for user 357cc1db02a5495fa2a7b72f48bd74e9 and project ffb7ac478c7a4eaab8266747de13eda0. Resources: {'cores', 'ram', 'instances'} {{(pid=98844) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 13:42:41.760152 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.manager [None req-945db856-d45e-4429-a4f0-01f42d875f56 tempest-InstanceActionsV221TestJSON-315468484 tempest-InstanceActionsV221TestJSON-315468484-project] [instance: 06d689dc-8337-4543-a9b1-4ed8fc902be9] Selected host: n-h1-791503-6; Selected node: n-h1-791503-6; Alternates: [('n-h2-791503-6', 'n-h2-791503-6')] {{(pid=98844) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 13:42:41.761808 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-945db856-d45e-4429-a4f0-01f42d875f56 tempest-InstanceActionsV221TestJSON-315468484 tempest-InstanceActionsV221TestJSON-315468484-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:42:41.762459 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-945db856-d45e-4429-a4f0-01f42d875f56 tempest-InstanceActionsV221TestJSON-315468484 tempest-InstanceActionsV221TestJSON-315468484-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:42:41.775716 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.manager [None req-945db856-d45e-4429-a4f0-01f42d875f56 tempest-InstanceActionsV221TestJSON-315468484 tempest-InstanceActionsV221TestJSON-315468484-project] [instance: 06d689dc-8337-4543-a9b1-4ed8fc902be9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='64f6036b-99a9-40e4-8963-3cdf66964954',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98844) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 13:42:41.777484 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-945db856-d45e-4429-a4f0-01f42d875f56 tempest-InstanceActionsV221TestJSON-315468484 tempest-InstanceActionsV221TestJSON-315468484-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:42:41.778114 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-945db856-d45e-4429-a4f0-01f42d875f56 tempest-InstanceActionsV221TestJSON-315468484 tempest-InstanceActionsV221TestJSON-315468484-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:42:41.832519 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-945db856-d45e-4429-a4f0-01f42d875f56 tempest-InstanceActionsV221TestJSON-315468484 tempest-InstanceActionsV221TestJSON-315468484-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:42:41.833237 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-945db856-d45e-4429-a4f0-01f42d875f56 tempest-InstanceActionsV221TestJSON-315468484 tempest-InstanceActionsV221TestJSON-315468484-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:43:12.442746 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-ce44280b-d107-4ed5-a405-35923da19539 tempest-MigrationsAdminTest-1666574026 tempest-MigrationsAdminTest-1666574026-project] Targeting cell b241212c-c279-4fbb-a1e7-b87889287cbf(cell1) for conductor method migrate_server {{(pid=98843) wrapper /opt/stack/nova/nova/conductor/manager.py:91}} May 28 13:43:12.443782 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-ce44280b-d107-4ed5-a405-35923da19539 tempest-MigrationsAdminTest-1666574026 tempest-MigrationsAdminTest-1666574026-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:43:12.447605 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-ce44280b-d107-4ed5-a405-35923da19539 tempest-MigrationsAdminTest-1666574026 tempest-MigrationsAdminTest-1666574026-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:43:13.165101 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.tasks.migrate [None req-ce44280b-d107-4ed5-a405-35923da19539 tempest-MigrationsAdminTest-1666574026 tempest-MigrationsAdminTest-1666574026-project] [instance: 4934f57e-c848-4b13-a429-8b8b9b39744d] Restricting to cell b241212c-c279-4fbb-a1e7-b87889287cbf(cell1) while migrating {{(pid=98843) _set_requested_destination_cell /opt/stack/nova/nova/conductor/tasks/migrate.py:208}} May 28 13:43:14.064780 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.tasks.migrate [None req-ce44280b-d107-4ed5-a405-35923da19539 tempest-MigrationsAdminTest-1666574026 tempest-MigrationsAdminTest-1666574026-project] Created allocations for migration a29432b4-a2f6-4555-8867-874e605e812b on d4341c2e-3ff0-43f5-9b7e-4ec6191a47d4 {{(pid=98843) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} May 28 13:43:15.046970 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.tasks.migrate [None req-ce44280b-d107-4ed5-a405-35923da19539 tempest-MigrationsAdminTest-1666574026 tempest-MigrationsAdminTest-1666574026-project] [instance: 4934f57e-c848-4b13-a429-8b8b9b39744d] Calling prep_resize with selected host: n-h1-791503-6; Selected node: n-h1-791503-6; Alternates: [Selection(allocation_request='{"allocations": {"5c5ac110-743a-4b71-a058-d2597ba8e0c9": {"resources": {"DISK_GB": 1, "MEMORY_MB": 512, "VCPU": 1}}}, "mappings": {"": ["5c5ac110-743a-4b71-a058-d2597ba8e0c9"]}}',allocation_request_version='1.35',availability_zone='nova',cell_uuid=b241212c-c279-4fbb-a1e7-b87889287cbf,compute_node_uuid=5c5ac110-743a-4b71-a058-d2597ba8e0c9,limits=SchedulerLimits,nodename='n-h2-791503-6',service_host='n-h2-791503-6')] {{(pid=98843) _execute /opt/stack/nova/nova/conductor/tasks/migrate.py:315}} May 28 13:43:35.589917 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.manager [None req-ff512fe9-ec41-42b0-bdc4-893740c8133f tempest-ServersAdminTestJSON-1710467438 tempest-ServersAdminTestJSON-1710467438-project] Targeting cell b241212c-c279-4fbb-a1e7-b87889287cbf(cell1) for conductor method rebuild_instance {{(pid=98844) wrapper /opt/stack/nova/nova/conductor/manager.py:91}} May 28 13:43:35.591824 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-ff512fe9-ec41-42b0-bdc4-893740c8133f tempest-ServersAdminTestJSON-1710467438 tempest-ServersAdminTestJSON-1710467438-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:43:35.592818 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-ff512fe9-ec41-42b0-bdc4-893740c8133f tempest-ServersAdminTestJSON-1710467438 tempest-ServersAdminTestJSON-1710467438-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:43:35.646173 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.manager [None req-ff512fe9-ec41-42b0-bdc4-893740c8133f tempest-ServersAdminTestJSON-1710467438 tempest-ServersAdminTestJSON-1710467438-project] [instance: b12277b0-847b-486b-b42c-c89448d03757] No migration record for the rebuild/evacuate request. {{(pid=98844) rebuild_instance /opt/stack/nova/nova/conductor/manager.py:1101}} May 28 13:44:15.067617 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-cfa5bdd4-3de8-4313-b773-2af196e092a0 tempest-ServerRescueTestJSON-898669982 tempest-ServerRescueTestJSON-898669982-project] Took 0.61 seconds to select destinations for 1 instance(s). {{(pid=98843) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 13:44:15.166159 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-cfa5bdd4-3de8-4313-b773-2af196e092a0 tempest-ServerRescueTestJSON-898669982 tempest-ServerRescueTestJSON-898669982-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:44:15.170052 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-cfa5bdd4-3de8-4313-b773-2af196e092a0 tempest-ServerRescueTestJSON-898669982 tempest-ServerRescueTestJSON-898669982-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:44:15.285910 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-cfa5bdd4-3de8-4313-b773-2af196e092a0 tempest-ServerRescueTestJSON-898669982 tempest-ServerRescueTestJSON-898669982-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:44:15.287879 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-cfa5bdd4-3de8-4313-b773-2af196e092a0 tempest-ServerRescueTestJSON-898669982 tempest-ServerRescueTestJSON-898669982-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:44:15.289814 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-cfa5bdd4-3de8-4313-b773-2af196e092a0 tempest-ServerRescueTestJSON-898669982 tempest-ServerRescueTestJSON-898669982-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:44:15.290289 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-cfa5bdd4-3de8-4313-b773-2af196e092a0 tempest-ServerRescueTestJSON-898669982 tempest-ServerRescueTestJSON-898669982-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:44:15.337739 n-d-791503-6 nova-conductor[98843]: DEBUG nova.quota [None req-cfa5bdd4-3de8-4313-b773-2af196e092a0 tempest-ServerRescueTestJSON-898669982 tempest-ServerRescueTestJSON-898669982-project] Getting quotas for project 04d87162aa1146d7b5f7d520b6a882a0. Resources: {'cores', 'ram', 'instances'} {{(pid=98843) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 13:44:15.351897 n-d-791503-6 nova-conductor[98843]: DEBUG nova.quota [None req-cfa5bdd4-3de8-4313-b773-2af196e092a0 tempest-ServerRescueTestJSON-898669982 tempest-ServerRescueTestJSON-898669982-project] Getting quotas for user 709fd98eb8df40f28250c23f5a193792 and project 04d87162aa1146d7b5f7d520b6a882a0. Resources: {'cores', 'ram', 'instances'} {{(pid=98843) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 13:44:15.384763 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-cfa5bdd4-3de8-4313-b773-2af196e092a0 tempest-ServerRescueTestJSON-898669982 tempest-ServerRescueTestJSON-898669982-project] [instance: ee857550-d1cb-47c3-bfd1-024cfda5e4e6] Selected host: n-h2-791503-6; Selected node: n-h2-791503-6; Alternates: [('n-h1-791503-6', 'n-h1-791503-6')] {{(pid=98843) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 13:44:15.386655 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-cfa5bdd4-3de8-4313-b773-2af196e092a0 tempest-ServerRescueTestJSON-898669982 tempest-ServerRescueTestJSON-898669982-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:44:15.388065 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-cfa5bdd4-3de8-4313-b773-2af196e092a0 tempest-ServerRescueTestJSON-898669982 tempest-ServerRescueTestJSON-898669982-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:44:15.422973 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-cfa5bdd4-3de8-4313-b773-2af196e092a0 tempest-ServerRescueTestJSON-898669982 tempest-ServerRescueTestJSON-898669982-project] [instance: ee857550-d1cb-47c3-bfd1-024cfda5e4e6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='64f6036b-99a9-40e4-8963-3cdf66964954',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98843) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 13:44:15.425520 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-cfa5bdd4-3de8-4313-b773-2af196e092a0 tempest-ServerRescueTestJSON-898669982 tempest-ServerRescueTestJSON-898669982-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:44:15.426436 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-cfa5bdd4-3de8-4313-b773-2af196e092a0 tempest-ServerRescueTestJSON-898669982 tempest-ServerRescueTestJSON-898669982-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:44:15.502878 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-cfa5bdd4-3de8-4313-b773-2af196e092a0 tempest-ServerRescueTestJSON-898669982 tempest-ServerRescueTestJSON-898669982-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:44:15.504847 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-cfa5bdd4-3de8-4313-b773-2af196e092a0 tempest-ServerRescueTestJSON-898669982 tempest-ServerRescueTestJSON-898669982-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:44:27.250333 n-d-791503-6 nova-conductor[98844]: ERROR oslo.messaging._drivers.impl_rabbit [-] [cbd7c90c-b59a-4f8b-992f-d04ba5ad6f9c] AMQP server on 10.222.0.68:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 28 13:44:28.297232 n-d-791503-6 nova-conductor[98844]: INFO oslo.messaging._drivers.impl_rabbit [-] [cbd7c90c-b59a-4f8b-992f-d04ba5ad6f9c] Reconnected to AMQP server on 10.222.0.68:5672 via [amqp] client with port 60710. May 28 13:44:41.439296 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.manager [None req-c2c85da4-c3b8-498d-ac27-038fa333f350 tempest-MigrationsAdminTest-1666574026 tempest-MigrationsAdminTest-1666574026-project] Took 0.46 seconds to select destinations for 1 instance(s). {{(pid=98844) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 13:44:41.467392 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-c2c85da4-c3b8-498d-ac27-038fa333f350 tempest-MigrationsAdminTest-1666574026 tempest-MigrationsAdminTest-1666574026-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:44:41.467905 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-c2c85da4-c3b8-498d-ac27-038fa333f350 tempest-MigrationsAdminTest-1666574026 tempest-MigrationsAdminTest-1666574026-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:44:41.531377 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-c2c85da4-c3b8-498d-ac27-038fa333f350 tempest-MigrationsAdminTest-1666574026 tempest-MigrationsAdminTest-1666574026-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:44:41.531933 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-c2c85da4-c3b8-498d-ac27-038fa333f350 tempest-MigrationsAdminTest-1666574026 tempest-MigrationsAdminTest-1666574026-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:44:41.533462 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-c2c85da4-c3b8-498d-ac27-038fa333f350 tempest-MigrationsAdminTest-1666574026 tempest-MigrationsAdminTest-1666574026-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:44:41.533695 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-c2c85da4-c3b8-498d-ac27-038fa333f350 tempest-MigrationsAdminTest-1666574026 tempest-MigrationsAdminTest-1666574026-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:44:41.555603 n-d-791503-6 nova-conductor[98844]: DEBUG nova.quota [None req-c2c85da4-c3b8-498d-ac27-038fa333f350 tempest-MigrationsAdminTest-1666574026 tempest-MigrationsAdminTest-1666574026-project] Getting quotas for project 1df09ab4f06c415fb230001e945a2e55. Resources: {'cores', 'ram', 'instances'} {{(pid=98844) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 13:44:41.561103 n-d-791503-6 nova-conductor[98844]: DEBUG nova.quota [None req-c2c85da4-c3b8-498d-ac27-038fa333f350 tempest-MigrationsAdminTest-1666574026 tempest-MigrationsAdminTest-1666574026-project] Getting quotas for user 18b64baf715545358827a2c540135008 and project 1df09ab4f06c415fb230001e945a2e55. Resources: {'cores', 'ram', 'instances'} {{(pid=98844) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 13:44:41.577954 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.manager [None req-c2c85da4-c3b8-498d-ac27-038fa333f350 tempest-MigrationsAdminTest-1666574026 tempest-MigrationsAdminTest-1666574026-project] [instance: 4b7acd92-26e1-4b24-866a-b775f55b4d79] Selected host: n-h1-791503-6; Selected node: n-h1-791503-6; Alternates: [('n-h2-791503-6', 'n-h2-791503-6')] {{(pid=98844) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 13:44:41.579256 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-c2c85da4-c3b8-498d-ac27-038fa333f350 tempest-MigrationsAdminTest-1666574026 tempest-MigrationsAdminTest-1666574026-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:44:41.579824 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-c2c85da4-c3b8-498d-ac27-038fa333f350 tempest-MigrationsAdminTest-1666574026 tempest-MigrationsAdminTest-1666574026-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:44:41.589534 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.manager [None req-c2c85da4-c3b8-498d-ac27-038fa333f350 tempest-MigrationsAdminTest-1666574026 tempest-MigrationsAdminTest-1666574026-project] [instance: 4b7acd92-26e1-4b24-866a-b775f55b4d79] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='64f6036b-99a9-40e4-8963-3cdf66964954',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98844) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 13:44:41.592701 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-c2c85da4-c3b8-498d-ac27-038fa333f350 tempest-MigrationsAdminTest-1666574026 tempest-MigrationsAdminTest-1666574026-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:44:41.593487 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-c2c85da4-c3b8-498d-ac27-038fa333f350 tempest-MigrationsAdminTest-1666574026 tempest-MigrationsAdminTest-1666574026-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:44:41.638464 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-c2c85da4-c3b8-498d-ac27-038fa333f350 tempest-MigrationsAdminTest-1666574026 tempest-MigrationsAdminTest-1666574026-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:44:41.639179 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-c2c85da4-c3b8-498d-ac27-038fa333f350 tempest-MigrationsAdminTest-1666574026 tempest-MigrationsAdminTest-1666574026-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:44:45.038853 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-b56c0b7a-e70c-45e7-b1a7-e4475540601f tempest-ServersAdminTestJSON-1710467438 tempest-ServersAdminTestJSON-1710467438-project] Targeting cell b241212c-c279-4fbb-a1e7-b87889287cbf(cell1) for conductor method rebuild_instance {{(pid=98843) wrapper /opt/stack/nova/nova/conductor/manager.py:91}} May 28 13:44:45.039822 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-b56c0b7a-e70c-45e7-b1a7-e4475540601f tempest-ServersAdminTestJSON-1710467438 tempest-ServersAdminTestJSON-1710467438-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:44:45.042824 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-b56c0b7a-e70c-45e7-b1a7-e4475540601f tempest-ServersAdminTestJSON-1710467438 tempest-ServersAdminTestJSON-1710467438-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:44:45.109314 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-b56c0b7a-e70c-45e7-b1a7-e4475540601f tempest-ServersAdminTestJSON-1710467438 tempest-ServersAdminTestJSON-1710467438-project] [instance: b12277b0-847b-486b-b42c-c89448d03757] No migration record for the rebuild/evacuate request. {{(pid=98843) rebuild_instance /opt/stack/nova/nova/conductor/manager.py:1101}} May 28 13:45:18.837621 n-d-791503-6 nova-conductor[98843]: ERROR oslo.messaging._drivers.impl_rabbit [-] [fb67aa64-250d-4c34-b696-14a5dd0b49b6] AMQP server on 10.222.0.68:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 28 13:45:19.613553 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.manager [None req-d839b553-ccf2-46fb-861c-e6b42c10fb8e tempest-ServerActionsTestJSON-1981342857 tempest-ServerActionsTestJSON-1981342857-project] Took 0.50 seconds to select destinations for 1 instance(s). {{(pid=98844) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 13:45:19.672121 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-d839b553-ccf2-46fb-861c-e6b42c10fb8e tempest-ServerActionsTestJSON-1981342857 tempest-ServerActionsTestJSON-1981342857-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:45:19.672802 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-d839b553-ccf2-46fb-861c-e6b42c10fb8e tempest-ServerActionsTestJSON-1981342857 tempest-ServerActionsTestJSON-1981342857-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:45:19.786962 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-d839b553-ccf2-46fb-861c-e6b42c10fb8e tempest-ServerActionsTestJSON-1981342857 tempest-ServerActionsTestJSON-1981342857-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:45:19.787381 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-d839b553-ccf2-46fb-861c-e6b42c10fb8e tempest-ServerActionsTestJSON-1981342857 tempest-ServerActionsTestJSON-1981342857-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:45:19.788104 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-d839b553-ccf2-46fb-861c-e6b42c10fb8e tempest-ServerActionsTestJSON-1981342857 tempest-ServerActionsTestJSON-1981342857-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:45:19.788701 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-d839b553-ccf2-46fb-861c-e6b42c10fb8e tempest-ServerActionsTestJSON-1981342857 tempest-ServerActionsTestJSON-1981342857-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:45:19.821726 n-d-791503-6 nova-conductor[98844]: DEBUG nova.quota [None req-d839b553-ccf2-46fb-861c-e6b42c10fb8e tempest-ServerActionsTestJSON-1981342857 tempest-ServerActionsTestJSON-1981342857-project] Getting quotas for project 5938fa909b2b41f3b9c83d7bed85496e. Resources: {'cores', 'ram', 'instances'} {{(pid=98844) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 13:45:19.833144 n-d-791503-6 nova-conductor[98844]: DEBUG nova.quota [None req-d839b553-ccf2-46fb-861c-e6b42c10fb8e tempest-ServerActionsTestJSON-1981342857 tempest-ServerActionsTestJSON-1981342857-project] Getting quotas for user b0fd2f9f85864877a8044e864e9eed29 and project 5938fa909b2b41f3b9c83d7bed85496e. Resources: {'cores', 'ram', 'instances'} {{(pid=98844) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 13:45:19.872089 n-d-791503-6 nova-conductor[98843]: INFO oslo.messaging._drivers.impl_rabbit [-] [fb67aa64-250d-4c34-b696-14a5dd0b49b6] Reconnected to AMQP server on 10.222.0.68:5672 via [amqp] client with port 33046. May 28 13:45:19.875937 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.manager [None req-d839b553-ccf2-46fb-861c-e6b42c10fb8e tempest-ServerActionsTestJSON-1981342857 tempest-ServerActionsTestJSON-1981342857-project] [instance: c762cbe9-2504-41a0-bd90-8cb922644785] Selected host: n-h1-791503-6; Selected node: n-h1-791503-6; Alternates: [('n-h2-791503-6', 'n-h2-791503-6')] {{(pid=98844) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 13:45:19.877110 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-d839b553-ccf2-46fb-861c-e6b42c10fb8e tempest-ServerActionsTestJSON-1981342857 tempest-ServerActionsTestJSON-1981342857-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:45:19.877722 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-d839b553-ccf2-46fb-861c-e6b42c10fb8e tempest-ServerActionsTestJSON-1981342857 tempest-ServerActionsTestJSON-1981342857-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:45:19.891749 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.manager [None req-d839b553-ccf2-46fb-861c-e6b42c10fb8e tempest-ServerActionsTestJSON-1981342857 tempest-ServerActionsTestJSON-1981342857-project] [instance: c762cbe9-2504-41a0-bd90-8cb922644785] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='64f6036b-99a9-40e4-8963-3cdf66964954',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98844) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 13:45:19.894111 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-d839b553-ccf2-46fb-861c-e6b42c10fb8e tempest-ServerActionsTestJSON-1981342857 tempest-ServerActionsTestJSON-1981342857-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:45:19.896223 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-d839b553-ccf2-46fb-861c-e6b42c10fb8e tempest-ServerActionsTestJSON-1981342857 tempest-ServerActionsTestJSON-1981342857-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:45:20.071792 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-d839b553-ccf2-46fb-861c-e6b42c10fb8e tempest-ServerActionsTestJSON-1981342857 tempest-ServerActionsTestJSON-1981342857-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:45:20.076431 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-d839b553-ccf2-46fb-861c-e6b42c10fb8e tempest-ServerActionsTestJSON-1981342857 tempest-ServerActionsTestJSON-1981342857-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:45:20.849566 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-8fb8ab84-1705-43d5-b2b0-cc372d544d5e tempest-ServerRescueTestJSON-898669982 tempest-ServerRescueTestJSON-898669982-project] Took 0.80 seconds to select destinations for 1 instance(s). {{(pid=98843) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 13:45:20.926930 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-8fb8ab84-1705-43d5-b2b0-cc372d544d5e tempest-ServerRescueTestJSON-898669982 tempest-ServerRescueTestJSON-898669982-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:45:20.930498 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-8fb8ab84-1705-43d5-b2b0-cc372d544d5e tempest-ServerRescueTestJSON-898669982 tempest-ServerRescueTestJSON-898669982-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:45:21.053384 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-8fb8ab84-1705-43d5-b2b0-cc372d544d5e tempest-ServerRescueTestJSON-898669982 tempest-ServerRescueTestJSON-898669982-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:45:21.055951 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-8fb8ab84-1705-43d5-b2b0-cc372d544d5e tempest-ServerRescueTestJSON-898669982 tempest-ServerRescueTestJSON-898669982-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:45:21.057392 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-8fb8ab84-1705-43d5-b2b0-cc372d544d5e tempest-ServerRescueTestJSON-898669982 tempest-ServerRescueTestJSON-898669982-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:45:21.062587 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-8fb8ab84-1705-43d5-b2b0-cc372d544d5e tempest-ServerRescueTestJSON-898669982 tempest-ServerRescueTestJSON-898669982-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:45:21.090704 n-d-791503-6 nova-conductor[98843]: DEBUG nova.quota [None req-8fb8ab84-1705-43d5-b2b0-cc372d544d5e tempest-ServerRescueTestJSON-898669982 tempest-ServerRescueTestJSON-898669982-project] Getting quotas for project 04d87162aa1146d7b5f7d520b6a882a0. Resources: {'cores', 'ram', 'instances'} {{(pid=98843) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 13:45:21.108223 n-d-791503-6 nova-conductor[98843]: DEBUG nova.quota [None req-8fb8ab84-1705-43d5-b2b0-cc372d544d5e tempest-ServerRescueTestJSON-898669982 tempest-ServerRescueTestJSON-898669982-project] Getting quotas for user 709fd98eb8df40f28250c23f5a193792 and project 04d87162aa1146d7b5f7d520b6a882a0. Resources: {'cores', 'ram', 'instances'} {{(pid=98843) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 13:45:21.155934 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-8fb8ab84-1705-43d5-b2b0-cc372d544d5e tempest-ServerRescueTestJSON-898669982 tempest-ServerRescueTestJSON-898669982-project] [instance: fd0b4097-13d6-4dc3-82cb-1afb4db9bc3d] Selected host: n-h1-791503-6; Selected node: n-h1-791503-6; Alternates: [('n-h2-791503-6', 'n-h2-791503-6')] {{(pid=98843) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 13:45:21.158347 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-8fb8ab84-1705-43d5-b2b0-cc372d544d5e tempest-ServerRescueTestJSON-898669982 tempest-ServerRescueTestJSON-898669982-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:45:21.162002 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-8fb8ab84-1705-43d5-b2b0-cc372d544d5e tempest-ServerRescueTestJSON-898669982 tempest-ServerRescueTestJSON-898669982-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:45:21.177508 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-8fb8ab84-1705-43d5-b2b0-cc372d544d5e tempest-ServerRescueTestJSON-898669982 tempest-ServerRescueTestJSON-898669982-project] [instance: fd0b4097-13d6-4dc3-82cb-1afb4db9bc3d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='64f6036b-99a9-40e4-8963-3cdf66964954',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98843) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 13:45:21.189475 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-8fb8ab84-1705-43d5-b2b0-cc372d544d5e tempest-ServerRescueTestJSON-898669982 tempest-ServerRescueTestJSON-898669982-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:45:21.190194 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-8fb8ab84-1705-43d5-b2b0-cc372d544d5e tempest-ServerRescueTestJSON-898669982 tempest-ServerRescueTestJSON-898669982-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:45:21.269980 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-8fb8ab84-1705-43d5-b2b0-cc372d544d5e tempest-ServerRescueTestJSON-898669982 tempest-ServerRescueTestJSON-898669982-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:45:21.270663 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-8fb8ab84-1705-43d5-b2b0-cc372d544d5e tempest-ServerRescueTestJSON-898669982 tempest-ServerRescueTestJSON-898669982-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:45:22.625021 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.manager [None req-8ac98a88-69a8-4e4d-b789-3de66afa1601 tempest-MigrationsAdminTest-1666574026 tempest-MigrationsAdminTest-1666574026-project] Targeting cell b241212c-c279-4fbb-a1e7-b87889287cbf(cell1) for conductor method migrate_server {{(pid=98844) wrapper /opt/stack/nova/nova/conductor/manager.py:91}} May 28 13:45:22.625866 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-8ac98a88-69a8-4e4d-b789-3de66afa1601 tempest-MigrationsAdminTest-1666574026 tempest-MigrationsAdminTest-1666574026-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:45:22.626110 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-8ac98a88-69a8-4e4d-b789-3de66afa1601 tempest-MigrationsAdminTest-1666574026 tempest-MigrationsAdminTest-1666574026-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:45:23.604011 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.tasks.migrate [None req-8ac98a88-69a8-4e4d-b789-3de66afa1601 tempest-MigrationsAdminTest-1666574026 tempest-MigrationsAdminTest-1666574026-project] [instance: 4b7acd92-26e1-4b24-866a-b775f55b4d79] Restricting to cell b241212c-c279-4fbb-a1e7-b87889287cbf(cell1) while migrating {{(pid=98844) _set_requested_destination_cell /opt/stack/nova/nova/conductor/tasks/migrate.py:208}} May 28 13:45:24.627007 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.tasks.migrate [None req-8ac98a88-69a8-4e4d-b789-3de66afa1601 tempest-MigrationsAdminTest-1666574026 tempest-MigrationsAdminTest-1666574026-project] Created allocations for migration 935ce6a1-7a06-4dd0-a03d-7e101917642e on d4341c2e-3ff0-43f5-9b7e-4ec6191a47d4 {{(pid=98844) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} May 28 13:45:25.394389 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.tasks.migrate [None req-8ac98a88-69a8-4e4d-b789-3de66afa1601 tempest-MigrationsAdminTest-1666574026 tempest-MigrationsAdminTest-1666574026-project] [instance: 4b7acd92-26e1-4b24-866a-b775f55b4d79] Calling prep_resize with selected host: n-h2-791503-6; Selected node: n-h2-791503-6; Alternates: [Selection(allocation_request='{"allocations": {"d4341c2e-3ff0-43f5-9b7e-4ec6191a47d4": {"resources": {"DISK_GB": 1, "MEMORY_MB": 512, "VCPU": 1}}}, "mappings": {"": ["d4341c2e-3ff0-43f5-9b7e-4ec6191a47d4"]}}',allocation_request_version='1.35',availability_zone='nova',cell_uuid=b241212c-c279-4fbb-a1e7-b87889287cbf,compute_node_uuid=d4341c2e-3ff0-43f5-9b7e-4ec6191a47d4,limits=SchedulerLimits,nodename='n-h1-791503-6',service_host='n-h1-791503-6')] {{(pid=98844) _execute /opt/stack/nova/nova/conductor/tasks/migrate.py:315}} May 28 13:45:48.954108 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-89c507f6-095b-4d5b-b0f0-28881b1bb1a4 tempest-AttachSCSIVolumeTestJSON-1644582955 tempest-AttachSCSIVolumeTestJSON-1644582955-project] Took 0.60 seconds to select destinations for 1 instance(s). {{(pid=98843) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 13:45:48.979488 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-89c507f6-095b-4d5b-b0f0-28881b1bb1a4 tempest-AttachSCSIVolumeTestJSON-1644582955 tempest-AttachSCSIVolumeTestJSON-1644582955-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:45:48.980166 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-89c507f6-095b-4d5b-b0f0-28881b1bb1a4 tempest-AttachSCSIVolumeTestJSON-1644582955 tempest-AttachSCSIVolumeTestJSON-1644582955-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:45:49.114705 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-89c507f6-095b-4d5b-b0f0-28881b1bb1a4 tempest-AttachSCSIVolumeTestJSON-1644582955 tempest-AttachSCSIVolumeTestJSON-1644582955-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:45:49.115386 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-89c507f6-095b-4d5b-b0f0-28881b1bb1a4 tempest-AttachSCSIVolumeTestJSON-1644582955 tempest-AttachSCSIVolumeTestJSON-1644582955-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:45:49.116277 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-89c507f6-095b-4d5b-b0f0-28881b1bb1a4 tempest-AttachSCSIVolumeTestJSON-1644582955 tempest-AttachSCSIVolumeTestJSON-1644582955-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:45:49.116686 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-89c507f6-095b-4d5b-b0f0-28881b1bb1a4 tempest-AttachSCSIVolumeTestJSON-1644582955 tempest-AttachSCSIVolumeTestJSON-1644582955-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:45:49.208806 n-d-791503-6 nova-conductor[98843]: DEBUG nova.quota [None req-89c507f6-095b-4d5b-b0f0-28881b1bb1a4 tempest-AttachSCSIVolumeTestJSON-1644582955 tempest-AttachSCSIVolumeTestJSON-1644582955-project] Getting quotas for project b50e1eb4c1df4b649bdafb77096d26a4. Resources: {'cores', 'ram', 'instances'} {{(pid=98843) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 13:45:49.225210 n-d-791503-6 nova-conductor[98843]: DEBUG nova.quota [None req-89c507f6-095b-4d5b-b0f0-28881b1bb1a4 tempest-AttachSCSIVolumeTestJSON-1644582955 tempest-AttachSCSIVolumeTestJSON-1644582955-project] Getting quotas for user 709eb09386df4a5db0d0283ebc4f16e2 and project b50e1eb4c1df4b649bdafb77096d26a4. Resources: {'cores', 'ram', 'instances'} {{(pid=98843) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 13:45:49.258077 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-89c507f6-095b-4d5b-b0f0-28881b1bb1a4 tempest-AttachSCSIVolumeTestJSON-1644582955 tempest-AttachSCSIVolumeTestJSON-1644582955-project] [instance: 715ee6f8-7082-416d-b0c6-8cd05822e2ea] Selected host: n-h2-791503-6; Selected node: n-h2-791503-6; Alternates: [('n-h1-791503-6', 'n-h1-791503-6')] {{(pid=98843) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 13:45:49.259814 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-89c507f6-095b-4d5b-b0f0-28881b1bb1a4 tempest-AttachSCSIVolumeTestJSON-1644582955 tempest-AttachSCSIVolumeTestJSON-1644582955-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:45:49.260298 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-89c507f6-095b-4d5b-b0f0-28881b1bb1a4 tempest-AttachSCSIVolumeTestJSON-1644582955 tempest-AttachSCSIVolumeTestJSON-1644582955-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:45:49.292877 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-89c507f6-095b-4d5b-b0f0-28881b1bb1a4 tempest-AttachSCSIVolumeTestJSON-1644582955 tempest-AttachSCSIVolumeTestJSON-1644582955-project] [instance: 715ee6f8-7082-416d-b0c6-8cd05822e2ea] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='74bb4aa9-3707-44d2-83e4-ef65374ecf34',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98843) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 13:45:49.294434 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-89c507f6-095b-4d5b-b0f0-28881b1bb1a4 tempest-AttachSCSIVolumeTestJSON-1644582955 tempest-AttachSCSIVolumeTestJSON-1644582955-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:45:49.294856 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-89c507f6-095b-4d5b-b0f0-28881b1bb1a4 tempest-AttachSCSIVolumeTestJSON-1644582955 tempest-AttachSCSIVolumeTestJSON-1644582955-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:45:49.360289 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-89c507f6-095b-4d5b-b0f0-28881b1bb1a4 tempest-AttachSCSIVolumeTestJSON-1644582955 tempest-AttachSCSIVolumeTestJSON-1644582955-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:45:49.361080 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-89c507f6-095b-4d5b-b0f0-28881b1bb1a4 tempest-AttachSCSIVolumeTestJSON-1644582955 tempest-AttachSCSIVolumeTestJSON-1644582955-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:46:13.497667 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.manager [None req-cc02f48d-ec77-45ea-b8a6-d443777ddc1b tempest-ServersOnMultiNodesTest-1721415881 tempest-ServersOnMultiNodesTest-1721415881-project] Took 0.79 seconds to select destinations for 1 instance(s). {{(pid=98844) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 13:46:13.536226 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-cc02f48d-ec77-45ea-b8a6-d443777ddc1b tempest-ServersOnMultiNodesTest-1721415881 tempest-ServersOnMultiNodesTest-1721415881-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:46:13.536943 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-cc02f48d-ec77-45ea-b8a6-d443777ddc1b tempest-ServersOnMultiNodesTest-1721415881 tempest-ServersOnMultiNodesTest-1721415881-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:46:13.622136 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-cc02f48d-ec77-45ea-b8a6-d443777ddc1b tempest-ServersOnMultiNodesTest-1721415881 tempest-ServersOnMultiNodesTest-1721415881-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:46:13.622615 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-cc02f48d-ec77-45ea-b8a6-d443777ddc1b tempest-ServersOnMultiNodesTest-1721415881 tempest-ServersOnMultiNodesTest-1721415881-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:46:13.623646 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-cc02f48d-ec77-45ea-b8a6-d443777ddc1b tempest-ServersOnMultiNodesTest-1721415881 tempest-ServersOnMultiNodesTest-1721415881-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:46:13.624284 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-cc02f48d-ec77-45ea-b8a6-d443777ddc1b tempest-ServersOnMultiNodesTest-1721415881 tempest-ServersOnMultiNodesTest-1721415881-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:46:13.647140 n-d-791503-6 nova-conductor[98844]: DEBUG nova.quota [None req-cc02f48d-ec77-45ea-b8a6-d443777ddc1b tempest-ServersOnMultiNodesTest-1721415881 tempest-ServersOnMultiNodesTest-1721415881-project] Getting quotas for project f206ea4609c44a5480b23c9b6034088a. Resources: {'cores', 'ram', 'instances'} {{(pid=98844) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 13:46:13.653257 n-d-791503-6 nova-conductor[98844]: DEBUG nova.quota [None req-cc02f48d-ec77-45ea-b8a6-d443777ddc1b tempest-ServersOnMultiNodesTest-1721415881 tempest-ServersOnMultiNodesTest-1721415881-project] Getting quotas for user ee4a8d9550014104b0ed215b6b097aaf and project f206ea4609c44a5480b23c9b6034088a. Resources: {'cores', 'ram', 'instances'} {{(pid=98844) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 13:46:13.669464 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.manager [None req-cc02f48d-ec77-45ea-b8a6-d443777ddc1b tempest-ServersOnMultiNodesTest-1721415881 tempest-ServersOnMultiNodesTest-1721415881-project] [instance: dd588878-1425-494b-8fd7-efc9683637ed] Selected host: n-h2-791503-6; Selected node: n-h2-791503-6; Alternates: [('n-h1-791503-6', 'n-h1-791503-6')] {{(pid=98844) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 13:46:13.671181 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-cc02f48d-ec77-45ea-b8a6-d443777ddc1b tempest-ServersOnMultiNodesTest-1721415881 tempest-ServersOnMultiNodesTest-1721415881-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:46:13.671768 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-cc02f48d-ec77-45ea-b8a6-d443777ddc1b tempest-ServersOnMultiNodesTest-1721415881 tempest-ServersOnMultiNodesTest-1721415881-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:46:13.689866 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.manager [None req-cc02f48d-ec77-45ea-b8a6-d443777ddc1b tempest-ServersOnMultiNodesTest-1721415881 tempest-ServersOnMultiNodesTest-1721415881-project] [instance: dd588878-1425-494b-8fd7-efc9683637ed] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='64f6036b-99a9-40e4-8963-3cdf66964954',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98844) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 13:46:13.691394 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-cc02f48d-ec77-45ea-b8a6-d443777ddc1b tempest-ServersOnMultiNodesTest-1721415881 tempest-ServersOnMultiNodesTest-1721415881-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:46:13.691935 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-cc02f48d-ec77-45ea-b8a6-d443777ddc1b tempest-ServersOnMultiNodesTest-1721415881 tempest-ServersOnMultiNodesTest-1721415881-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:46:13.734955 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-cc02f48d-ec77-45ea-b8a6-d443777ddc1b tempest-ServersOnMultiNodesTest-1721415881 tempest-ServersOnMultiNodesTest-1721415881-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:46:13.736084 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-cc02f48d-ec77-45ea-b8a6-d443777ddc1b tempest-ServersOnMultiNodesTest-1721415881 tempest-ServersOnMultiNodesTest-1721415881-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:46:34.078954 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-9c0c9f36-9066-4ffe-b79f-59110c25aacf tempest-MigrationsAdminTest-1666574026 tempest-MigrationsAdminTest-1666574026-project] Took 0.59 seconds to select destinations for 1 instance(s). {{(pid=98843) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 13:46:34.171895 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-9c0c9f36-9066-4ffe-b79f-59110c25aacf tempest-MigrationsAdminTest-1666574026 tempest-MigrationsAdminTest-1666574026-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:46:34.172927 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-9c0c9f36-9066-4ffe-b79f-59110c25aacf tempest-MigrationsAdminTest-1666574026 tempest-MigrationsAdminTest-1666574026-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:46:34.367844 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-9c0c9f36-9066-4ffe-b79f-59110c25aacf tempest-MigrationsAdminTest-1666574026 tempest-MigrationsAdminTest-1666574026-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:46:34.372115 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-9c0c9f36-9066-4ffe-b79f-59110c25aacf tempest-MigrationsAdminTest-1666574026 tempest-MigrationsAdminTest-1666574026-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:46:34.375825 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-9c0c9f36-9066-4ffe-b79f-59110c25aacf tempest-MigrationsAdminTest-1666574026 tempest-MigrationsAdminTest-1666574026-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:46:34.390292 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-9c0c9f36-9066-4ffe-b79f-59110c25aacf tempest-MigrationsAdminTest-1666574026 tempest-MigrationsAdminTest-1666574026-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:46:34.456430 n-d-791503-6 nova-conductor[98843]: DEBUG nova.quota [None req-9c0c9f36-9066-4ffe-b79f-59110c25aacf tempest-MigrationsAdminTest-1666574026 tempest-MigrationsAdminTest-1666574026-project] Getting quotas for project 1df09ab4f06c415fb230001e945a2e55. Resources: {'cores', 'ram', 'instances'} {{(pid=98843) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 13:46:34.473711 n-d-791503-6 nova-conductor[98843]: DEBUG nova.quota [None req-9c0c9f36-9066-4ffe-b79f-59110c25aacf tempest-MigrationsAdminTest-1666574026 tempest-MigrationsAdminTest-1666574026-project] Getting quotas for user 18b64baf715545358827a2c540135008 and project 1df09ab4f06c415fb230001e945a2e55. Resources: {'cores', 'ram', 'instances'} {{(pid=98843) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 13:46:34.521235 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-9c0c9f36-9066-4ffe-b79f-59110c25aacf tempest-MigrationsAdminTest-1666574026 tempest-MigrationsAdminTest-1666574026-project] [instance: 71a110d2-1e3c-4271-a129-9b2e3cb48e10] Selected host: n-h2-791503-6; Selected node: n-h2-791503-6; Alternates: [('n-h1-791503-6', 'n-h1-791503-6')] {{(pid=98843) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 13:46:34.529304 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-9c0c9f36-9066-4ffe-b79f-59110c25aacf tempest-MigrationsAdminTest-1666574026 tempest-MigrationsAdminTest-1666574026-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:46:34.534227 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-9c0c9f36-9066-4ffe-b79f-59110c25aacf tempest-MigrationsAdminTest-1666574026 tempest-MigrationsAdminTest-1666574026-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:46:34.573229 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-9c0c9f36-9066-4ffe-b79f-59110c25aacf tempest-MigrationsAdminTest-1666574026 tempest-MigrationsAdminTest-1666574026-project] [instance: 71a110d2-1e3c-4271-a129-9b2e3cb48e10] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='64f6036b-99a9-40e4-8963-3cdf66964954',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98843) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 13:46:34.590892 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-9c0c9f36-9066-4ffe-b79f-59110c25aacf tempest-MigrationsAdminTest-1666574026 tempest-MigrationsAdminTest-1666574026-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:46:34.597868 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-9c0c9f36-9066-4ffe-b79f-59110c25aacf tempest-MigrationsAdminTest-1666574026 tempest-MigrationsAdminTest-1666574026-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:46:34.702328 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-9c0c9f36-9066-4ffe-b79f-59110c25aacf tempest-MigrationsAdminTest-1666574026 tempest-MigrationsAdminTest-1666574026-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:46:34.703046 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-9c0c9f36-9066-4ffe-b79f-59110c25aacf tempest-MigrationsAdminTest-1666574026 tempest-MigrationsAdminTest-1666574026-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:46:39.054276 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.manager [None req-722f06e5-2d2c-4b89-bc73-7fadf3686584 tempest-ServerActionsTestJSON-1981342857 tempest-ServerActionsTestJSON-1981342857-project] Took 0.56 seconds to select destinations for 1 instance(s). {{(pid=98844) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 13:46:39.181535 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-722f06e5-2d2c-4b89-bc73-7fadf3686584 tempest-ServerActionsTestJSON-1981342857 tempest-ServerActionsTestJSON-1981342857-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:46:39.182734 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-722f06e5-2d2c-4b89-bc73-7fadf3686584 tempest-ServerActionsTestJSON-1981342857 tempest-ServerActionsTestJSON-1981342857-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:46:39.279333 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-722f06e5-2d2c-4b89-bc73-7fadf3686584 tempest-ServerActionsTestJSON-1981342857 tempest-ServerActionsTestJSON-1981342857-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:46:39.279892 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-722f06e5-2d2c-4b89-bc73-7fadf3686584 tempest-ServerActionsTestJSON-1981342857 tempest-ServerActionsTestJSON-1981342857-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:46:39.281134 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-722f06e5-2d2c-4b89-bc73-7fadf3686584 tempest-ServerActionsTestJSON-1981342857 tempest-ServerActionsTestJSON-1981342857-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:46:39.282778 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-722f06e5-2d2c-4b89-bc73-7fadf3686584 tempest-ServerActionsTestJSON-1981342857 tempest-ServerActionsTestJSON-1981342857-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:46:39.327840 n-d-791503-6 nova-conductor[98844]: DEBUG nova.quota [None req-722f06e5-2d2c-4b89-bc73-7fadf3686584 tempest-ServerActionsTestJSON-1981342857 tempest-ServerActionsTestJSON-1981342857-project] Getting quotas for project 5938fa909b2b41f3b9c83d7bed85496e. Resources: {'cores', 'ram', 'instances'} {{(pid=98844) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 13:46:39.367199 n-d-791503-6 nova-conductor[98844]: DEBUG nova.quota [None req-722f06e5-2d2c-4b89-bc73-7fadf3686584 tempest-ServerActionsTestJSON-1981342857 tempest-ServerActionsTestJSON-1981342857-project] Getting quotas for user b0fd2f9f85864877a8044e864e9eed29 and project 5938fa909b2b41f3b9c83d7bed85496e. Resources: {'cores', 'ram', 'instances'} {{(pid=98844) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 13:46:39.428151 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.manager [None req-722f06e5-2d2c-4b89-bc73-7fadf3686584 tempest-ServerActionsTestJSON-1981342857 tempest-ServerActionsTestJSON-1981342857-project] [instance: d23b4163-2291-4462-93db-34b851275612] Selected host: n-h1-791503-6; Selected node: n-h1-791503-6; Alternates: [('n-h2-791503-6', 'n-h2-791503-6')] {{(pid=98844) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 13:46:39.432246 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-722f06e5-2d2c-4b89-bc73-7fadf3686584 tempest-ServerActionsTestJSON-1981342857 tempest-ServerActionsTestJSON-1981342857-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:46:39.435427 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-722f06e5-2d2c-4b89-bc73-7fadf3686584 tempest-ServerActionsTestJSON-1981342857 tempest-ServerActionsTestJSON-1981342857-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:46:39.454736 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.manager [None req-722f06e5-2d2c-4b89-bc73-7fadf3686584 tempest-ServerActionsTestJSON-1981342857 tempest-ServerActionsTestJSON-1981342857-project] [instance: d23b4163-2291-4462-93db-34b851275612] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='64f6036b-99a9-40e4-8963-3cdf66964954',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98844) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 13:46:39.459829 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-722f06e5-2d2c-4b89-bc73-7fadf3686584 tempest-ServerActionsTestJSON-1981342857 tempest-ServerActionsTestJSON-1981342857-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:46:39.461071 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-722f06e5-2d2c-4b89-bc73-7fadf3686584 tempest-ServerActionsTestJSON-1981342857 tempest-ServerActionsTestJSON-1981342857-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:46:39.609146 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-722f06e5-2d2c-4b89-bc73-7fadf3686584 tempest-ServerActionsTestJSON-1981342857 tempest-ServerActionsTestJSON-1981342857-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:46:39.611415 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-722f06e5-2d2c-4b89-bc73-7fadf3686584 tempest-ServerActionsTestJSON-1981342857 tempest-ServerActionsTestJSON-1981342857-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:46:47.346119 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-9dc3fac8-0d4f-4f3a-b301-f56d6856421d tempest-ServersOnMultiNodesTest-1721415881 tempest-ServersOnMultiNodesTest-1721415881-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:46:47.347938 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-9dc3fac8-0d4f-4f3a-b301-f56d6856421d tempest-ServersOnMultiNodesTest-1721415881 tempest-ServersOnMultiNodesTest-1721415881-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:46:48.163300 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-9dc3fac8-0d4f-4f3a-b301-f56d6856421d tempest-ServersOnMultiNodesTest-1721415881 tempest-ServersOnMultiNodesTest-1721415881-project] Took 0.74 seconds to select destinations for 2 instance(s). {{(pid=98843) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 13:46:48.244642 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-9dc3fac8-0d4f-4f3a-b301-f56d6856421d tempest-ServersOnMultiNodesTest-1721415881 tempest-ServersOnMultiNodesTest-1721415881-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:46:48.245585 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-9dc3fac8-0d4f-4f3a-b301-f56d6856421d tempest-ServersOnMultiNodesTest-1721415881 tempest-ServersOnMultiNodesTest-1721415881-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:46:48.345676 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-9dc3fac8-0d4f-4f3a-b301-f56d6856421d tempest-ServersOnMultiNodesTest-1721415881 tempest-ServersOnMultiNodesTest-1721415881-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:46:48.346647 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-9dc3fac8-0d4f-4f3a-b301-f56d6856421d tempest-ServersOnMultiNodesTest-1721415881 tempest-ServersOnMultiNodesTest-1721415881-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:46:48.441329 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-9dc3fac8-0d4f-4f3a-b301-f56d6856421d tempest-ServersOnMultiNodesTest-1721415881 tempest-ServersOnMultiNodesTest-1721415881-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:46:48.441910 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-9dc3fac8-0d4f-4f3a-b301-f56d6856421d tempest-ServersOnMultiNodesTest-1721415881 tempest-ServersOnMultiNodesTest-1721415881-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:46:48.444957 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-9dc3fac8-0d4f-4f3a-b301-f56d6856421d tempest-ServersOnMultiNodesTest-1721415881 tempest-ServersOnMultiNodesTest-1721415881-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:46:48.446036 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-9dc3fac8-0d4f-4f3a-b301-f56d6856421d tempest-ServersOnMultiNodesTest-1721415881 tempest-ServersOnMultiNodesTest-1721415881-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:46:48.487028 n-d-791503-6 nova-conductor[98843]: DEBUG nova.quota [None req-9dc3fac8-0d4f-4f3a-b301-f56d6856421d tempest-ServersOnMultiNodesTest-1721415881 tempest-ServersOnMultiNodesTest-1721415881-project] Getting quotas for project f206ea4609c44a5480b23c9b6034088a. Resources: {'cores', 'ram', 'instances'} {{(pid=98843) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 13:46:48.505819 n-d-791503-6 nova-conductor[98843]: DEBUG nova.quota [None req-9dc3fac8-0d4f-4f3a-b301-f56d6856421d tempest-ServersOnMultiNodesTest-1721415881 tempest-ServersOnMultiNodesTest-1721415881-project] Getting quotas for user ee4a8d9550014104b0ed215b6b097aaf and project f206ea4609c44a5480b23c9b6034088a. Resources: {'cores', 'ram', 'instances'} {{(pid=98843) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 13:46:48.539310 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-9dc3fac8-0d4f-4f3a-b301-f56d6856421d tempest-ServersOnMultiNodesTest-1721415881 tempest-ServersOnMultiNodesTest-1721415881-project] [instance: 02901312-0d18-4cc6-bce1-ca77c4ce5326] Selected host: n-h1-791503-6; Selected node: n-h1-791503-6; Alternates: [] {{(pid=98843) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 13:46:48.542500 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-9dc3fac8-0d4f-4f3a-b301-f56d6856421d tempest-ServersOnMultiNodesTest-1721415881 tempest-ServersOnMultiNodesTest-1721415881-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:46:48.544069 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-9dc3fac8-0d4f-4f3a-b301-f56d6856421d tempest-ServersOnMultiNodesTest-1721415881 tempest-ServersOnMultiNodesTest-1721415881-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:46:48.562926 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-9dc3fac8-0d4f-4f3a-b301-f56d6856421d tempest-ServersOnMultiNodesTest-1721415881 tempest-ServersOnMultiNodesTest-1721415881-project] [instance: 02901312-0d18-4cc6-bce1-ca77c4ce5326] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='64f6036b-99a9-40e4-8963-3cdf66964954',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98843) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 13:46:48.567238 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-9dc3fac8-0d4f-4f3a-b301-f56d6856421d tempest-ServersOnMultiNodesTest-1721415881 tempest-ServersOnMultiNodesTest-1721415881-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:46:48.569132 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-9dc3fac8-0d4f-4f3a-b301-f56d6856421d tempest-ServersOnMultiNodesTest-1721415881 tempest-ServersOnMultiNodesTest-1721415881-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:46:48.652797 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-9dc3fac8-0d4f-4f3a-b301-f56d6856421d tempest-ServersOnMultiNodesTest-1721415881 tempest-ServersOnMultiNodesTest-1721415881-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:46:48.653990 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-9dc3fac8-0d4f-4f3a-b301-f56d6856421d tempest-ServersOnMultiNodesTest-1721415881 tempest-ServersOnMultiNodesTest-1721415881-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:46:48.666551 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-9dc3fac8-0d4f-4f3a-b301-f56d6856421d tempest-ServersOnMultiNodesTest-1721415881 tempest-ServersOnMultiNodesTest-1721415881-project] [instance: 9f707c19-f248-40d6-babc-5d0f8020d1b9] Selected host: n-h1-791503-6; Selected node: n-h1-791503-6; Alternates: [] {{(pid=98843) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 13:46:48.667693 n-d-791503-6 nova-conductor[98843]: DEBUG nova.objects.instance_group [None req-9dc3fac8-0d4f-4f3a-b301-f56d6856421d tempest-ServersOnMultiNodesTest-1721415881 tempest-ServersOnMultiNodesTest-1721415881-project] Lazy-loading 'hosts' on InstanceGroup uuid a0c21fad-e6c0-42b9-83d9-015d687d7d39 {{(pid=98843) obj_load_attr /opt/stack/nova/nova/objects/instance_group.py:357}} May 28 13:46:48.680629 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-9dc3fac8-0d4f-4f3a-b301-f56d6856421d tempest-ServersOnMultiNodesTest-1721415881 tempest-ServersOnMultiNodesTest-1721415881-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:46:48.681205 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-9dc3fac8-0d4f-4f3a-b301-f56d6856421d tempest-ServersOnMultiNodesTest-1721415881 tempest-ServersOnMultiNodesTest-1721415881-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:46:48.696601 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-9dc3fac8-0d4f-4f3a-b301-f56d6856421d tempest-ServersOnMultiNodesTest-1721415881 tempest-ServersOnMultiNodesTest-1721415881-project] [instance: 9f707c19-f248-40d6-babc-5d0f8020d1b9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='64f6036b-99a9-40e4-8963-3cdf66964954',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98843) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 13:46:48.698950 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-9dc3fac8-0d4f-4f3a-b301-f56d6856421d tempest-ServersOnMultiNodesTest-1721415881 tempest-ServersOnMultiNodesTest-1721415881-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:46:48.699629 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-9dc3fac8-0d4f-4f3a-b301-f56d6856421d tempest-ServersOnMultiNodesTest-1721415881 tempest-ServersOnMultiNodesTest-1721415881-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:46:48.748790 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-9dc3fac8-0d4f-4f3a-b301-f56d6856421d tempest-ServersOnMultiNodesTest-1721415881 tempest-ServersOnMultiNodesTest-1721415881-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:46:48.749874 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-9dc3fac8-0d4f-4f3a-b301-f56d6856421d tempest-ServersOnMultiNodesTest-1721415881 tempest-ServersOnMultiNodesTest-1721415881-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:46:53.627988 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.manager [None req-01502a27-f93a-4548-87a4-bf969cb58fb0 tempest-ServersTestBootFromVolume-1826735808 tempest-ServersTestBootFromVolume-1826735808-project] Took 0.79 seconds to select destinations for 1 instance(s). {{(pid=98844) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 13:46:53.735157 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-01502a27-f93a-4548-87a4-bf969cb58fb0 tempest-ServersTestBootFromVolume-1826735808 tempest-ServersTestBootFromVolume-1826735808-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:46:53.737361 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-01502a27-f93a-4548-87a4-bf969cb58fb0 tempest-ServersTestBootFromVolume-1826735808 tempest-ServersTestBootFromVolume-1826735808-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:46:53.894120 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-01502a27-f93a-4548-87a4-bf969cb58fb0 tempest-ServersTestBootFromVolume-1826735808 tempest-ServersTestBootFromVolume-1826735808-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:46:53.894529 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-01502a27-f93a-4548-87a4-bf969cb58fb0 tempest-ServersTestBootFromVolume-1826735808 tempest-ServersTestBootFromVolume-1826735808-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:46:53.895301 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-01502a27-f93a-4548-87a4-bf969cb58fb0 tempest-ServersTestBootFromVolume-1826735808 tempest-ServersTestBootFromVolume-1826735808-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:46:53.903021 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-01502a27-f93a-4548-87a4-bf969cb58fb0 tempest-ServersTestBootFromVolume-1826735808 tempest-ServersTestBootFromVolume-1826735808-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:46:53.945989 n-d-791503-6 nova-conductor[98844]: DEBUG nova.quota [None req-01502a27-f93a-4548-87a4-bf969cb58fb0 tempest-ServersTestBootFromVolume-1826735808 tempest-ServersTestBootFromVolume-1826735808-project] Getting quotas for project fb62c663506648ebbf847fcce44129c5. Resources: {'cores', 'ram', 'instances'} {{(pid=98844) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 13:46:53.956245 n-d-791503-6 nova-conductor[98844]: DEBUG nova.quota [None req-01502a27-f93a-4548-87a4-bf969cb58fb0 tempest-ServersTestBootFromVolume-1826735808 tempest-ServersTestBootFromVolume-1826735808-project] Getting quotas for user 5f0172b18e39418286195bfefb480619 and project fb62c663506648ebbf847fcce44129c5. Resources: {'cores', 'ram', 'instances'} {{(pid=98844) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 13:46:53.981615 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.manager [None req-01502a27-f93a-4548-87a4-bf969cb58fb0 tempest-ServersTestBootFromVolume-1826735808 tempest-ServersTestBootFromVolume-1826735808-project] [instance: 2f7c3e9b-e1ba-4139-ad46-8f5e4daaf921] Selected host: n-h2-791503-6; Selected node: n-h2-791503-6; Alternates: [('n-h1-791503-6', 'n-h1-791503-6')] {{(pid=98844) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 13:46:53.984029 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-01502a27-f93a-4548-87a4-bf969cb58fb0 tempest-ServersTestBootFromVolume-1826735808 tempest-ServersTestBootFromVolume-1826735808-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:46:53.985105 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-01502a27-f93a-4548-87a4-bf969cb58fb0 tempest-ServersTestBootFromVolume-1826735808 tempest-ServersTestBootFromVolume-1826735808-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:46:53.999583 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.manager [None req-01502a27-f93a-4548-87a4-bf969cb58fb0 tempest-ServersTestBootFromVolume-1826735808 tempest-ServersTestBootFromVolume-1826735808-project] [instance: 2f7c3e9b-e1ba-4139-ad46-8f5e4daaf921] block_device_mapping [BlockDeviceMapping(attachment_id=2c8f1f06-df85-46f5-bb58-91ce48918452,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b43d4331-671f-42f8-87c1-98e77e68dd31',volume_size=1,volume_type=None)] {{(pid=98844) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 13:46:54.003899 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-01502a27-f93a-4548-87a4-bf969cb58fb0 tempest-ServersTestBootFromVolume-1826735808 tempest-ServersTestBootFromVolume-1826735808-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:46:54.005843 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-01502a27-f93a-4548-87a4-bf969cb58fb0 tempest-ServersTestBootFromVolume-1826735808 tempest-ServersTestBootFromVolume-1826735808-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:46:54.094074 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-01502a27-f93a-4548-87a4-bf969cb58fb0 tempest-ServersTestBootFromVolume-1826735808 tempest-ServersTestBootFromVolume-1826735808-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:46:54.095912 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-01502a27-f93a-4548-87a4-bf969cb58fb0 tempest-ServersTestBootFromVolume-1826735808 tempest-ServersTestBootFromVolume-1826735808-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:46:55.720939 n-d-791503-6 nova-conductor[98844]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 13:47:08.810308 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-bf8f9e29-dcd5-4e32-b665-9488a69337e0 tempest-MigrationsAdminTest-1925540011 tempest-MigrationsAdminTest-1925540011-project-admin] Targeting cell b241212c-c279-4fbb-a1e7-b87889287cbf(cell1) for conductor method migrate_server {{(pid=98843) wrapper /opt/stack/nova/nova/conductor/manager.py:91}} May 28 13:47:08.811882 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-bf8f9e29-dcd5-4e32-b665-9488a69337e0 tempest-MigrationsAdminTest-1925540011 tempest-MigrationsAdminTest-1925540011-project-admin] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:47:08.812611 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-bf8f9e29-dcd5-4e32-b665-9488a69337e0 tempest-MigrationsAdminTest-1925540011 tempest-MigrationsAdminTest-1925540011-project-admin] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:47:09.079594 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.tasks.migrate [None req-bf8f9e29-dcd5-4e32-b665-9488a69337e0 tempest-MigrationsAdminTest-1925540011 tempest-MigrationsAdminTest-1925540011-project-admin] [instance: 71a110d2-1e3c-4271-a129-9b2e3cb48e10] Restricting to cell b241212c-c279-4fbb-a1e7-b87889287cbf(cell1) while migrating {{(pid=98843) _set_requested_destination_cell /opt/stack/nova/nova/conductor/tasks/migrate.py:208}} May 28 13:47:09.622779 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.tasks.migrate [None req-bf8f9e29-dcd5-4e32-b665-9488a69337e0 tempest-MigrationsAdminTest-1925540011 tempest-MigrationsAdminTest-1925540011-project-admin] Created allocations for migration d796ac40-765e-435f-b0bd-76ecc929333e on 5c5ac110-743a-4b71-a058-d2597ba8e0c9 {{(pid=98843) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} May 28 13:47:09.963035 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.tasks.migrate [None req-bf8f9e29-dcd5-4e32-b665-9488a69337e0 tempest-MigrationsAdminTest-1925540011 tempest-MigrationsAdminTest-1925540011-project-admin] [instance: 71a110d2-1e3c-4271-a129-9b2e3cb48e10] Calling prep_resize with selected host: n-h1-791503-6; Selected node: n-h1-791503-6; Alternates: [] {{(pid=98843) _execute /opt/stack/nova/nova/conductor/tasks/migrate.py:315}} May 28 13:47:28.288182 n-d-791503-6 nova-conductor[98844]: ERROR oslo.messaging._drivers.impl_rabbit [-] [cbd7c90c-b59a-4f8b-992f-d04ba5ad6f9c] AMQP server on 10.222.0.68:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection May 28 13:47:29.327060 n-d-791503-6 nova-conductor[98844]: INFO oslo.messaging._drivers.impl_rabbit [-] [cbd7c90c-b59a-4f8b-992f-d04ba5ad6f9c] Reconnected to AMQP server on 10.222.0.68:5672 via [amqp] client with port 34690. May 28 13:47:36.373534 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-cbcb348d-fe84-4aef-bb8e-4813cd066e9a tempest-ServersOnMultiNodesTest-1721415881 tempest-ServersOnMultiNodesTest-1721415881-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:47:36.380459 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-cbcb348d-fe84-4aef-bb8e-4813cd066e9a tempest-ServersOnMultiNodesTest-1721415881 tempest-ServersOnMultiNodesTest-1721415881-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:47:37.325874 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-097c7caf-0810-4dc6-8a71-697b00181de2 tempest-SecurityGroupsTestJSON-1356675580 tempest-SecurityGroupsTestJSON-1356675580-project] Took 0.83 seconds to select destinations for 1 instance(s). {{(pid=98843) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 13:47:37.441515 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-097c7caf-0810-4dc6-8a71-697b00181de2 tempest-SecurityGroupsTestJSON-1356675580 tempest-SecurityGroupsTestJSON-1356675580-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:47:37.446492 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-097c7caf-0810-4dc6-8a71-697b00181de2 tempest-SecurityGroupsTestJSON-1356675580 tempest-SecurityGroupsTestJSON-1356675580-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:47:37.456694 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.manager [None req-cbcb348d-fe84-4aef-bb8e-4813cd066e9a tempest-ServersOnMultiNodesTest-1721415881 tempest-ServersOnMultiNodesTest-1721415881-project] Took 1.01 seconds to select destinations for 2 instance(s). {{(pid=98844) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 13:47:37.557529 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-cbcb348d-fe84-4aef-bb8e-4813cd066e9a tempest-ServersOnMultiNodesTest-1721415881 tempest-ServersOnMultiNodesTest-1721415881-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:47:37.559599 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-cbcb348d-fe84-4aef-bb8e-4813cd066e9a tempest-ServersOnMultiNodesTest-1721415881 tempest-ServersOnMultiNodesTest-1721415881-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:47:37.567713 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-097c7caf-0810-4dc6-8a71-697b00181de2 tempest-SecurityGroupsTestJSON-1356675580 tempest-SecurityGroupsTestJSON-1356675580-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:47:37.568788 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-097c7caf-0810-4dc6-8a71-697b00181de2 tempest-SecurityGroupsTestJSON-1356675580 tempest-SecurityGroupsTestJSON-1356675580-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:47:37.571261 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-097c7caf-0810-4dc6-8a71-697b00181de2 tempest-SecurityGroupsTestJSON-1356675580 tempest-SecurityGroupsTestJSON-1356675580-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:47:37.572344 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-097c7caf-0810-4dc6-8a71-697b00181de2 tempest-SecurityGroupsTestJSON-1356675580 tempest-SecurityGroupsTestJSON-1356675580-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:47:37.627517 n-d-791503-6 nova-conductor[98843]: DEBUG nova.quota [None req-097c7caf-0810-4dc6-8a71-697b00181de2 tempest-SecurityGroupsTestJSON-1356675580 tempest-SecurityGroupsTestJSON-1356675580-project] Getting quotas for project a14923790b6c4b2089feab066a4254e6. Resources: {'cores', 'ram', 'instances'} {{(pid=98843) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 13:47:37.641462 n-d-791503-6 nova-conductor[98843]: DEBUG nova.quota [None req-097c7caf-0810-4dc6-8a71-697b00181de2 tempest-SecurityGroupsTestJSON-1356675580 tempest-SecurityGroupsTestJSON-1356675580-project] Getting quotas for user da44e05edda74d138944431841a7bf85 and project a14923790b6c4b2089feab066a4254e6. Resources: {'cores', 'ram', 'instances'} {{(pid=98843) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 13:47:37.667508 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-097c7caf-0810-4dc6-8a71-697b00181de2 tempest-SecurityGroupsTestJSON-1356675580 tempest-SecurityGroupsTestJSON-1356675580-project] [instance: a5229ecd-4960-4405-9f34-ed30f959e187] Selected host: n-h1-791503-6; Selected node: n-h1-791503-6; Alternates: [('n-h2-791503-6', 'n-h2-791503-6')] {{(pid=98843) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 13:47:37.669643 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-097c7caf-0810-4dc6-8a71-697b00181de2 tempest-SecurityGroupsTestJSON-1356675580 tempest-SecurityGroupsTestJSON-1356675580-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:47:37.670607 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-097c7caf-0810-4dc6-8a71-697b00181de2 tempest-SecurityGroupsTestJSON-1356675580 tempest-SecurityGroupsTestJSON-1356675580-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:47:37.684638 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-097c7caf-0810-4dc6-8a71-697b00181de2 tempest-SecurityGroupsTestJSON-1356675580 tempest-SecurityGroupsTestJSON-1356675580-project] [instance: a5229ecd-4960-4405-9f34-ed30f959e187] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='64f6036b-99a9-40e4-8963-3cdf66964954',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98843) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 13:47:37.687855 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-097c7caf-0810-4dc6-8a71-697b00181de2 tempest-SecurityGroupsTestJSON-1356675580 tempest-SecurityGroupsTestJSON-1356675580-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:47:37.692565 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-097c7caf-0810-4dc6-8a71-697b00181de2 tempest-SecurityGroupsTestJSON-1356675580 tempest-SecurityGroupsTestJSON-1356675580-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:47:37.758192 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-097c7caf-0810-4dc6-8a71-697b00181de2 tempest-SecurityGroupsTestJSON-1356675580 tempest-SecurityGroupsTestJSON-1356675580-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:47:37.758667 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-097c7caf-0810-4dc6-8a71-697b00181de2 tempest-SecurityGroupsTestJSON-1356675580 tempest-SecurityGroupsTestJSON-1356675580-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:47:37.848709 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-cbcb348d-fe84-4aef-bb8e-4813cd066e9a tempest-ServersOnMultiNodesTest-1721415881 tempest-ServersOnMultiNodesTest-1721415881-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:47:37.849678 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-cbcb348d-fe84-4aef-bb8e-4813cd066e9a tempest-ServersOnMultiNodesTest-1721415881 tempest-ServersOnMultiNodesTest-1721415881-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:47:37.985502 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-cbcb348d-fe84-4aef-bb8e-4813cd066e9a tempest-ServersOnMultiNodesTest-1721415881 tempest-ServersOnMultiNodesTest-1721415881-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:47:37.986216 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-cbcb348d-fe84-4aef-bb8e-4813cd066e9a tempest-ServersOnMultiNodesTest-1721415881 tempest-ServersOnMultiNodesTest-1721415881-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:47:37.988653 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-cbcb348d-fe84-4aef-bb8e-4813cd066e9a tempest-ServersOnMultiNodesTest-1721415881 tempest-ServersOnMultiNodesTest-1721415881-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:47:37.989916 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-cbcb348d-fe84-4aef-bb8e-4813cd066e9a tempest-ServersOnMultiNodesTest-1721415881 tempest-ServersOnMultiNodesTest-1721415881-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:47:38.044928 n-d-791503-6 nova-conductor[98844]: DEBUG nova.quota [None req-cbcb348d-fe84-4aef-bb8e-4813cd066e9a tempest-ServersOnMultiNodesTest-1721415881 tempest-ServersOnMultiNodesTest-1721415881-project] Getting quotas for project f206ea4609c44a5480b23c9b6034088a. Resources: {'cores', 'ram', 'instances'} {{(pid=98844) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 13:47:38.080497 n-d-791503-6 nova-conductor[98844]: DEBUG nova.quota [None req-cbcb348d-fe84-4aef-bb8e-4813cd066e9a tempest-ServersOnMultiNodesTest-1721415881 tempest-ServersOnMultiNodesTest-1721415881-project] Getting quotas for user ee4a8d9550014104b0ed215b6b097aaf and project f206ea4609c44a5480b23c9b6034088a. Resources: {'cores', 'ram', 'instances'} {{(pid=98844) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 13:47:38.168420 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.manager [None req-cbcb348d-fe84-4aef-bb8e-4813cd066e9a tempest-ServersOnMultiNodesTest-1721415881 tempest-ServersOnMultiNodesTest-1721415881-project] [instance: 1f8711c7-5e78-4628-aac8-473b1f6d1d17] Selected host: n-h1-791503-6; Selected node: n-h1-791503-6; Alternates: [] {{(pid=98844) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 13:47:38.174800 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-cbcb348d-fe84-4aef-bb8e-4813cd066e9a tempest-ServersOnMultiNodesTest-1721415881 tempest-ServersOnMultiNodesTest-1721415881-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:47:38.178158 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-cbcb348d-fe84-4aef-bb8e-4813cd066e9a tempest-ServersOnMultiNodesTest-1721415881 tempest-ServersOnMultiNodesTest-1721415881-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:47:38.219661 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.manager [None req-cbcb348d-fe84-4aef-bb8e-4813cd066e9a tempest-ServersOnMultiNodesTest-1721415881 tempest-ServersOnMultiNodesTest-1721415881-project] [instance: 1f8711c7-5e78-4628-aac8-473b1f6d1d17] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='64f6036b-99a9-40e4-8963-3cdf66964954',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98844) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 13:47:38.224050 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-cbcb348d-fe84-4aef-bb8e-4813cd066e9a tempest-ServersOnMultiNodesTest-1721415881 tempest-ServersOnMultiNodesTest-1721415881-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:47:38.227125 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-cbcb348d-fe84-4aef-bb8e-4813cd066e9a tempest-ServersOnMultiNodesTest-1721415881 tempest-ServersOnMultiNodesTest-1721415881-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:47:38.344167 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-cbcb348d-fe84-4aef-bb8e-4813cd066e9a tempest-ServersOnMultiNodesTest-1721415881 tempest-ServersOnMultiNodesTest-1721415881-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:47:38.345320 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-cbcb348d-fe84-4aef-bb8e-4813cd066e9a tempest-ServersOnMultiNodesTest-1721415881 tempest-ServersOnMultiNodesTest-1721415881-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:47:38.381927 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.manager [None req-cbcb348d-fe84-4aef-bb8e-4813cd066e9a tempest-ServersOnMultiNodesTest-1721415881 tempest-ServersOnMultiNodesTest-1721415881-project] [instance: eeb5d9e1-06f0-4871-9c0b-37310ec31456] Selected host: n-h2-791503-6; Selected node: n-h2-791503-6; Alternates: [] {{(pid=98844) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 13:47:38.383015 n-d-791503-6 nova-conductor[98844]: DEBUG nova.objects.instance_group [None req-cbcb348d-fe84-4aef-bb8e-4813cd066e9a tempest-ServersOnMultiNodesTest-1721415881 tempest-ServersOnMultiNodesTest-1721415881-project] Lazy-loading 'hosts' on InstanceGroup uuid 0eedbd91-221c-45a6-b358-e7c585ed4fc4 {{(pid=98844) obj_load_attr /opt/stack/nova/nova/objects/instance_group.py:357}} May 28 13:47:38.423276 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-cbcb348d-fe84-4aef-bb8e-4813cd066e9a tempest-ServersOnMultiNodesTest-1721415881 tempest-ServersOnMultiNodesTest-1721415881-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:47:38.423996 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-cbcb348d-fe84-4aef-bb8e-4813cd066e9a tempest-ServersOnMultiNodesTest-1721415881 tempest-ServersOnMultiNodesTest-1721415881-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:47:38.482425 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.manager [None req-cbcb348d-fe84-4aef-bb8e-4813cd066e9a tempest-ServersOnMultiNodesTest-1721415881 tempest-ServersOnMultiNodesTest-1721415881-project] [instance: eeb5d9e1-06f0-4871-9c0b-37310ec31456] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='64f6036b-99a9-40e4-8963-3cdf66964954',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98844) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 13:47:38.488751 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-cbcb348d-fe84-4aef-bb8e-4813cd066e9a tempest-ServersOnMultiNodesTest-1721415881 tempest-ServersOnMultiNodesTest-1721415881-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:47:38.491429 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-cbcb348d-fe84-4aef-bb8e-4813cd066e9a tempest-ServersOnMultiNodesTest-1721415881 tempest-ServersOnMultiNodesTest-1721415881-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:47:38.635552 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-cbcb348d-fe84-4aef-bb8e-4813cd066e9a tempest-ServersOnMultiNodesTest-1721415881 tempest-ServersOnMultiNodesTest-1721415881-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:47:38.636342 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-cbcb348d-fe84-4aef-bb8e-4813cd066e9a tempest-ServersOnMultiNodesTest-1721415881 tempest-ServersOnMultiNodesTest-1721415881-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:47:57.208922 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.manager [None req-9535ccd0-7479-48d1-8332-ce327054bc28 tempest-ServerRescueTestJSONUnderV235-39640193 tempest-ServerRescueTestJSONUnderV235-39640193-project] Took 0.83 seconds to select destinations for 1 instance(s). {{(pid=98844) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 13:47:57.252865 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-9535ccd0-7479-48d1-8332-ce327054bc28 tempest-ServerRescueTestJSONUnderV235-39640193 tempest-ServerRescueTestJSONUnderV235-39640193-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:47:57.253906 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-9535ccd0-7479-48d1-8332-ce327054bc28 tempest-ServerRescueTestJSONUnderV235-39640193 tempest-ServerRescueTestJSONUnderV235-39640193-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:47:57.370340 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-9535ccd0-7479-48d1-8332-ce327054bc28 tempest-ServerRescueTestJSONUnderV235-39640193 tempest-ServerRescueTestJSONUnderV235-39640193-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:47:57.371044 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-9535ccd0-7479-48d1-8332-ce327054bc28 tempest-ServerRescueTestJSONUnderV235-39640193 tempest-ServerRescueTestJSONUnderV235-39640193-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:47:57.372107 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-9535ccd0-7479-48d1-8332-ce327054bc28 tempest-ServerRescueTestJSONUnderV235-39640193 tempest-ServerRescueTestJSONUnderV235-39640193-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:47:57.372700 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-9535ccd0-7479-48d1-8332-ce327054bc28 tempest-ServerRescueTestJSONUnderV235-39640193 tempest-ServerRescueTestJSONUnderV235-39640193-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:47:57.403906 n-d-791503-6 nova-conductor[98844]: DEBUG nova.quota [None req-9535ccd0-7479-48d1-8332-ce327054bc28 tempest-ServerRescueTestJSONUnderV235-39640193 tempest-ServerRescueTestJSONUnderV235-39640193-project] Getting quotas for project 01cd019dc94f47f08ba658f8b7d11c4d. Resources: {'cores', 'ram', 'instances'} {{(pid=98844) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 13:47:57.429550 n-d-791503-6 nova-conductor[98844]: DEBUG nova.quota [None req-9535ccd0-7479-48d1-8332-ce327054bc28 tempest-ServerRescueTestJSONUnderV235-39640193 tempest-ServerRescueTestJSONUnderV235-39640193-project] Getting quotas for user c60523554e064f4a8d9898dda30e44c0 and project 01cd019dc94f47f08ba658f8b7d11c4d. Resources: {'cores', 'ram', 'instances'} {{(pid=98844) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 13:47:57.492568 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.manager [None req-9535ccd0-7479-48d1-8332-ce327054bc28 tempest-ServerRescueTestJSONUnderV235-39640193 tempest-ServerRescueTestJSONUnderV235-39640193-project] [instance: aa2f38ab-a678-4610-9813-aab4acbccf42] Selected host: n-h2-791503-6; Selected node: n-h2-791503-6; Alternates: [('n-h1-791503-6', 'n-h1-791503-6')] {{(pid=98844) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 13:47:57.494504 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-9535ccd0-7479-48d1-8332-ce327054bc28 tempest-ServerRescueTestJSONUnderV235-39640193 tempest-ServerRescueTestJSONUnderV235-39640193-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:47:57.495146 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-9535ccd0-7479-48d1-8332-ce327054bc28 tempest-ServerRescueTestJSONUnderV235-39640193 tempest-ServerRescueTestJSONUnderV235-39640193-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:47:57.517768 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.manager [None req-9535ccd0-7479-48d1-8332-ce327054bc28 tempest-ServerRescueTestJSONUnderV235-39640193 tempest-ServerRescueTestJSONUnderV235-39640193-project] [instance: aa2f38ab-a678-4610-9813-aab4acbccf42] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='64f6036b-99a9-40e4-8963-3cdf66964954',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98844) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 13:47:57.520640 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-9535ccd0-7479-48d1-8332-ce327054bc28 tempest-ServerRescueTestJSONUnderV235-39640193 tempest-ServerRescueTestJSONUnderV235-39640193-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:47:57.522115 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-9535ccd0-7479-48d1-8332-ce327054bc28 tempest-ServerRescueTestJSONUnderV235-39640193 tempest-ServerRescueTestJSONUnderV235-39640193-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:47:57.600815 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-9535ccd0-7479-48d1-8332-ce327054bc28 tempest-ServerRescueTestJSONUnderV235-39640193 tempest-ServerRescueTestJSONUnderV235-39640193-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:47:57.602912 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-9535ccd0-7479-48d1-8332-ce327054bc28 tempest-ServerRescueTestJSONUnderV235-39640193 tempest-ServerRescueTestJSONUnderV235-39640193-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:48:05.211331 n-d-791503-6 nova-conductor[98843]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 13:48:18.593921 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-50b4bf79-1c1c-4070-9a46-8ba1a835ee1b tempest-ServersNegativeTestJSON-848961242 tempest-ServersNegativeTestJSON-848961242-project] Targeting cell b241212c-c279-4fbb-a1e7-b87889287cbf(cell1) for conductor method unshelve_instance {{(pid=98843) wrapper /opt/stack/nova/nova/conductor/manager.py:91}} May 28 13:48:18.595337 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-50b4bf79-1c1c-4070-9a46-8ba1a835ee1b tempest-ServersNegativeTestJSON-848961242 tempest-ServersNegativeTestJSON-848961242-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:48:18.596109 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-50b4bf79-1c1c-4070-9a46-8ba1a835ee1b tempest-ServersNegativeTestJSON-848961242 tempest-ServersNegativeTestJSON-848961242-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:48:19.573028 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-50b4bf79-1c1c-4070-9a46-8ba1a835ee1b tempest-ServersNegativeTestJSON-848961242 tempest-ServersNegativeTestJSON-848961242-project] [instance: 35dac88f-ae2f-4199-ba19-6d0c12ddcc04] Requesting cell b241212c-c279-4fbb-a1e7-b87889287cbf(cell1) during scheduling {{(pid=98843) _restrict_request_spec_to_cell /opt/stack/nova/nova/conductor/manager.py:902}} May 28 13:48:19.869235 n-d-791503-6 nova-conductor[98843]: ERROR oslo.messaging._drivers.impl_rabbit [-] [fb67aa64-250d-4c34-b696-14a5dd0b49b6] AMQP server on 10.222.0.68:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 28 13:48:20.244403 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-50b4bf79-1c1c-4070-9a46-8ba1a835ee1b tempest-ServersNegativeTestJSON-848961242 tempest-ServersNegativeTestJSON-848961242-project] Took 0.65 seconds to select destinations for 1 instance(s). {{(pid=98843) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 13:48:20.254454 n-d-791503-6 nova-conductor[98843]: DEBUG nova.objects.instance [None req-50b4bf79-1c1c-4070-9a46-8ba1a835ee1b tempest-ServersNegativeTestJSON-848961242 tempest-ServersNegativeTestJSON-848961242-project] Lazy-loading 'flavor' on Instance uuid 35dac88f-ae2f-4199-ba19-6d0c12ddcc04 {{(pid=98843) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 28 13:48:20.925083 n-d-791503-6 nova-conductor[98843]: INFO oslo.messaging._drivers.impl_rabbit [-] [fb67aa64-250d-4c34-b696-14a5dd0b49b6] Reconnected to AMQP server on 10.222.0.68:5672 via [amqp] client with port 35098. May 28 13:48:46.317252 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.manager [None req-1ea7145c-08c7-4546-bb28-cd2ed13c30d9 tempest-ServersOnMultiNodesTest-1721415881 tempest-ServersOnMultiNodesTest-1721415881-project] Took 0.32 seconds to select destinations for 1 instance(s). {{(pid=98844) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 13:48:46.350943 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-1ea7145c-08c7-4546-bb28-cd2ed13c30d9 tempest-ServersOnMultiNodesTest-1721415881 tempest-ServersOnMultiNodesTest-1721415881-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:48:46.351626 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-1ea7145c-08c7-4546-bb28-cd2ed13c30d9 tempest-ServersOnMultiNodesTest-1721415881 tempest-ServersOnMultiNodesTest-1721415881-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:48:46.409145 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-1ea7145c-08c7-4546-bb28-cd2ed13c30d9 tempest-ServersOnMultiNodesTest-1721415881 tempest-ServersOnMultiNodesTest-1721415881-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:48:46.409628 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-1ea7145c-08c7-4546-bb28-cd2ed13c30d9 tempest-ServersOnMultiNodesTest-1721415881 tempest-ServersOnMultiNodesTest-1721415881-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:48:46.410546 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-1ea7145c-08c7-4546-bb28-cd2ed13c30d9 tempest-ServersOnMultiNodesTest-1721415881 tempest-ServersOnMultiNodesTest-1721415881-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:48:46.411177 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-1ea7145c-08c7-4546-bb28-cd2ed13c30d9 tempest-ServersOnMultiNodesTest-1721415881 tempest-ServersOnMultiNodesTest-1721415881-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:48:46.436521 n-d-791503-6 nova-conductor[98844]: DEBUG nova.quota [None req-1ea7145c-08c7-4546-bb28-cd2ed13c30d9 tempest-ServersOnMultiNodesTest-1721415881 tempest-ServersOnMultiNodesTest-1721415881-project] Getting quotas for project f206ea4609c44a5480b23c9b6034088a. Resources: {'cores', 'ram', 'instances'} {{(pid=98844) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 13:48:46.446976 n-d-791503-6 nova-conductor[98844]: DEBUG nova.quota [None req-1ea7145c-08c7-4546-bb28-cd2ed13c30d9 tempest-ServersOnMultiNodesTest-1721415881 tempest-ServersOnMultiNodesTest-1721415881-project] Getting quotas for user ee4a8d9550014104b0ed215b6b097aaf and project f206ea4609c44a5480b23c9b6034088a. Resources: {'cores', 'ram', 'instances'} {{(pid=98844) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 13:48:46.468779 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.manager [None req-1ea7145c-08c7-4546-bb28-cd2ed13c30d9 tempest-ServersOnMultiNodesTest-1721415881 tempest-ServersOnMultiNodesTest-1721415881-project] [instance: 610a6638-b93e-4a69-a45d-88375ab60d3c] Selected host: n-h1-791503-6; Selected node: n-h1-791503-6; Alternates: [] {{(pid=98844) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 13:48:46.470528 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-1ea7145c-08c7-4546-bb28-cd2ed13c30d9 tempest-ServersOnMultiNodesTest-1721415881 tempest-ServersOnMultiNodesTest-1721415881-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:48:46.471237 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-1ea7145c-08c7-4546-bb28-cd2ed13c30d9 tempest-ServersOnMultiNodesTest-1721415881 tempest-ServersOnMultiNodesTest-1721415881-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:48:46.482420 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.manager [None req-1ea7145c-08c7-4546-bb28-cd2ed13c30d9 tempest-ServersOnMultiNodesTest-1721415881 tempest-ServersOnMultiNodesTest-1721415881-project] [instance: 610a6638-b93e-4a69-a45d-88375ab60d3c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='64f6036b-99a9-40e4-8963-3cdf66964954',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98844) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 13:48:46.485698 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-1ea7145c-08c7-4546-bb28-cd2ed13c30d9 tempest-ServersOnMultiNodesTest-1721415881 tempest-ServersOnMultiNodesTest-1721415881-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:48:46.486805 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-1ea7145c-08c7-4546-bb28-cd2ed13c30d9 tempest-ServersOnMultiNodesTest-1721415881 tempest-ServersOnMultiNodesTest-1721415881-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:48:46.533587 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-1ea7145c-08c7-4546-bb28-cd2ed13c30d9 tempest-ServersOnMultiNodesTest-1721415881 tempest-ServersOnMultiNodesTest-1721415881-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:48:46.534265 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-1ea7145c-08c7-4546-bb28-cd2ed13c30d9 tempest-ServersOnMultiNodesTest-1721415881 tempest-ServersOnMultiNodesTest-1721415881-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:49:12.536211 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-005b5bc1-6392-44e5-8098-eaf126748371 tempest-SecurityGroupsTestJSON-1356675580 tempest-SecurityGroupsTestJSON-1356675580-project] Took 0.37 seconds to select destinations for 1 instance(s). {{(pid=98843) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 13:49:12.565639 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-005b5bc1-6392-44e5-8098-eaf126748371 tempest-SecurityGroupsTestJSON-1356675580 tempest-SecurityGroupsTestJSON-1356675580-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:49:12.566478 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-005b5bc1-6392-44e5-8098-eaf126748371 tempest-SecurityGroupsTestJSON-1356675580 tempest-SecurityGroupsTestJSON-1356675580-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:49:12.618125 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-005b5bc1-6392-44e5-8098-eaf126748371 tempest-SecurityGroupsTestJSON-1356675580 tempest-SecurityGroupsTestJSON-1356675580-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:49:12.618696 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-005b5bc1-6392-44e5-8098-eaf126748371 tempest-SecurityGroupsTestJSON-1356675580 tempest-SecurityGroupsTestJSON-1356675580-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:49:12.619674 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-005b5bc1-6392-44e5-8098-eaf126748371 tempest-SecurityGroupsTestJSON-1356675580 tempest-SecurityGroupsTestJSON-1356675580-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:49:12.620341 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-005b5bc1-6392-44e5-8098-eaf126748371 tempest-SecurityGroupsTestJSON-1356675580 tempest-SecurityGroupsTestJSON-1356675580-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:49:12.644463 n-d-791503-6 nova-conductor[98843]: DEBUG nova.quota [None req-005b5bc1-6392-44e5-8098-eaf126748371 tempest-SecurityGroupsTestJSON-1356675580 tempest-SecurityGroupsTestJSON-1356675580-project] Getting quotas for project a14923790b6c4b2089feab066a4254e6. Resources: {'cores', 'ram', 'instances'} {{(pid=98843) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 13:49:12.651407 n-d-791503-6 nova-conductor[98843]: DEBUG nova.quota [None req-005b5bc1-6392-44e5-8098-eaf126748371 tempest-SecurityGroupsTestJSON-1356675580 tempest-SecurityGroupsTestJSON-1356675580-project] Getting quotas for user da44e05edda74d138944431841a7bf85 and project a14923790b6c4b2089feab066a4254e6. Resources: {'cores', 'ram', 'instances'} {{(pid=98843) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 13:49:12.672616 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-005b5bc1-6392-44e5-8098-eaf126748371 tempest-SecurityGroupsTestJSON-1356675580 tempest-SecurityGroupsTestJSON-1356675580-project] [instance: ed1bc7fe-9101-4c52-a6ae-2053ea11f08c] Selected host: n-h1-791503-6; Selected node: n-h1-791503-6; Alternates: [('n-h2-791503-6', 'n-h2-791503-6')] {{(pid=98843) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 13:49:12.674306 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-005b5bc1-6392-44e5-8098-eaf126748371 tempest-SecurityGroupsTestJSON-1356675580 tempest-SecurityGroupsTestJSON-1356675580-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:49:12.675541 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-005b5bc1-6392-44e5-8098-eaf126748371 tempest-SecurityGroupsTestJSON-1356675580 tempest-SecurityGroupsTestJSON-1356675580-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:49:12.689886 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-005b5bc1-6392-44e5-8098-eaf126748371 tempest-SecurityGroupsTestJSON-1356675580 tempest-SecurityGroupsTestJSON-1356675580-project] [instance: ed1bc7fe-9101-4c52-a6ae-2053ea11f08c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='64f6036b-99a9-40e4-8963-3cdf66964954',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98843) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 13:49:12.692473 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-005b5bc1-6392-44e5-8098-eaf126748371 tempest-SecurityGroupsTestJSON-1356675580 tempest-SecurityGroupsTestJSON-1356675580-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:49:12.693160 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-005b5bc1-6392-44e5-8098-eaf126748371 tempest-SecurityGroupsTestJSON-1356675580 tempest-SecurityGroupsTestJSON-1356675580-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:49:12.746392 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-005b5bc1-6392-44e5-8098-eaf126748371 tempest-SecurityGroupsTestJSON-1356675580 tempest-SecurityGroupsTestJSON-1356675580-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:49:12.746936 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-005b5bc1-6392-44e5-8098-eaf126748371 tempest-SecurityGroupsTestJSON-1356675580 tempest-SecurityGroupsTestJSON-1356675580-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:49:17.462848 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.manager [None req-b330efb6-f97f-449d-89de-261cc50b23f2 tempest-ServersOnMultiNodesTest-1721415881 tempest-ServersOnMultiNodesTest-1721415881-project] Took 0.36 seconds to select destinations for 1 instance(s). {{(pid=98844) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 13:49:17.488518 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-b330efb6-f97f-449d-89de-261cc50b23f2 tempest-ServersOnMultiNodesTest-1721415881 tempest-ServersOnMultiNodesTest-1721415881-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:49:17.489280 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-b330efb6-f97f-449d-89de-261cc50b23f2 tempest-ServersOnMultiNodesTest-1721415881 tempest-ServersOnMultiNodesTest-1721415881-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:49:17.584137 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-b330efb6-f97f-449d-89de-261cc50b23f2 tempest-ServersOnMultiNodesTest-1721415881 tempest-ServersOnMultiNodesTest-1721415881-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:49:17.585008 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-b330efb6-f97f-449d-89de-261cc50b23f2 tempest-ServersOnMultiNodesTest-1721415881 tempest-ServersOnMultiNodesTest-1721415881-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:49:17.586379 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-b330efb6-f97f-449d-89de-261cc50b23f2 tempest-ServersOnMultiNodesTest-1721415881 tempest-ServersOnMultiNodesTest-1721415881-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:49:17.587212 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-b330efb6-f97f-449d-89de-261cc50b23f2 tempest-ServersOnMultiNodesTest-1721415881 tempest-ServersOnMultiNodesTest-1721415881-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:49:17.630251 n-d-791503-6 nova-conductor[98844]: DEBUG nova.quota [None req-b330efb6-f97f-449d-89de-261cc50b23f2 tempest-ServersOnMultiNodesTest-1721415881 tempest-ServersOnMultiNodesTest-1721415881-project] Getting quotas for project f206ea4609c44a5480b23c9b6034088a. Resources: {'cores', 'ram', 'instances'} {{(pid=98844) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 13:49:17.653486 n-d-791503-6 nova-conductor[98844]: DEBUG nova.quota [None req-b330efb6-f97f-449d-89de-261cc50b23f2 tempest-ServersOnMultiNodesTest-1721415881 tempest-ServersOnMultiNodesTest-1721415881-project] Getting quotas for user ee4a8d9550014104b0ed215b6b097aaf and project f206ea4609c44a5480b23c9b6034088a. Resources: {'cores', 'ram', 'instances'} {{(pid=98844) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 13:49:17.699442 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.manager [None req-b330efb6-f97f-449d-89de-261cc50b23f2 tempest-ServersOnMultiNodesTest-1721415881 tempest-ServersOnMultiNodesTest-1721415881-project] [instance: c4ce2572-fe91-44ec-8eae-471a614ef834] Selected host: n-h1-791503-6; Selected node: n-h1-791503-6; Alternates: [] {{(pid=98844) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 13:49:17.704788 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-b330efb6-f97f-449d-89de-261cc50b23f2 tempest-ServersOnMultiNodesTest-1721415881 tempest-ServersOnMultiNodesTest-1721415881-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:49:17.705918 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-b330efb6-f97f-449d-89de-261cc50b23f2 tempest-ServersOnMultiNodesTest-1721415881 tempest-ServersOnMultiNodesTest-1721415881-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:49:17.719046 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.manager [None req-b330efb6-f97f-449d-89de-261cc50b23f2 tempest-ServersOnMultiNodesTest-1721415881 tempest-ServersOnMultiNodesTest-1721415881-project] [instance: c4ce2572-fe91-44ec-8eae-471a614ef834] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='64f6036b-99a9-40e4-8963-3cdf66964954',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98844) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 13:49:17.723193 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-b330efb6-f97f-449d-89de-261cc50b23f2 tempest-ServersOnMultiNodesTest-1721415881 tempest-ServersOnMultiNodesTest-1721415881-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:49:17.724607 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-b330efb6-f97f-449d-89de-261cc50b23f2 tempest-ServersOnMultiNodesTest-1721415881 tempest-ServersOnMultiNodesTest-1721415881-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:49:17.792343 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-b330efb6-f97f-449d-89de-261cc50b23f2 tempest-ServersOnMultiNodesTest-1721415881 tempest-ServersOnMultiNodesTest-1721415881-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:49:17.794487 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-b330efb6-f97f-449d-89de-261cc50b23f2 tempest-ServersOnMultiNodesTest-1721415881 tempest-ServersOnMultiNodesTest-1721415881-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:49:35.588021 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-d5f093bf-74c6-4655-a665-2eebf176a91e tempest-ServerActionsTestJSON-1981342857 tempest-ServerActionsTestJSON-1981342857-project] Took 0.66 seconds to select destinations for 1 instance(s). {{(pid=98843) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 13:49:35.662816 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-d5f093bf-74c6-4655-a665-2eebf176a91e tempest-ServerActionsTestJSON-1981342857 tempest-ServerActionsTestJSON-1981342857-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:49:35.663939 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-d5f093bf-74c6-4655-a665-2eebf176a91e tempest-ServerActionsTestJSON-1981342857 tempest-ServerActionsTestJSON-1981342857-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:49:35.768827 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-d5f093bf-74c6-4655-a665-2eebf176a91e tempest-ServerActionsTestJSON-1981342857 tempest-ServerActionsTestJSON-1981342857-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:49:35.771748 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-d5f093bf-74c6-4655-a665-2eebf176a91e tempest-ServerActionsTestJSON-1981342857 tempest-ServerActionsTestJSON-1981342857-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:49:35.773506 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-d5f093bf-74c6-4655-a665-2eebf176a91e tempest-ServerActionsTestJSON-1981342857 tempest-ServerActionsTestJSON-1981342857-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:49:35.774313 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-d5f093bf-74c6-4655-a665-2eebf176a91e tempest-ServerActionsTestJSON-1981342857 tempest-ServerActionsTestJSON-1981342857-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:49:35.809517 n-d-791503-6 nova-conductor[98843]: DEBUG nova.quota [None req-d5f093bf-74c6-4655-a665-2eebf176a91e tempest-ServerActionsTestJSON-1981342857 tempest-ServerActionsTestJSON-1981342857-project] Getting quotas for project 5938fa909b2b41f3b9c83d7bed85496e. Resources: {'cores', 'ram', 'instances'} {{(pid=98843) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 13:49:35.819503 n-d-791503-6 nova-conductor[98843]: DEBUG nova.quota [None req-d5f093bf-74c6-4655-a665-2eebf176a91e tempest-ServerActionsTestJSON-1981342857 tempest-ServerActionsTestJSON-1981342857-project] Getting quotas for user b0fd2f9f85864877a8044e864e9eed29 and project 5938fa909b2b41f3b9c83d7bed85496e. Resources: {'cores', 'ram', 'instances'} {{(pid=98843) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 13:49:35.841390 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-d5f093bf-74c6-4655-a665-2eebf176a91e tempest-ServerActionsTestJSON-1981342857 tempest-ServerActionsTestJSON-1981342857-project] [instance: a2d37014-2537-419c-9bf2-a758335689de] Selected host: n-h2-791503-6; Selected node: n-h2-791503-6; Alternates: [('n-h1-791503-6', 'n-h1-791503-6')] {{(pid=98843) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 13:49:35.843033 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-d5f093bf-74c6-4655-a665-2eebf176a91e tempest-ServerActionsTestJSON-1981342857 tempest-ServerActionsTestJSON-1981342857-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:49:35.843976 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-d5f093bf-74c6-4655-a665-2eebf176a91e tempest-ServerActionsTestJSON-1981342857 tempest-ServerActionsTestJSON-1981342857-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:49:35.868861 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-d5f093bf-74c6-4655-a665-2eebf176a91e tempest-ServerActionsTestJSON-1981342857 tempest-ServerActionsTestJSON-1981342857-project] [instance: a2d37014-2537-419c-9bf2-a758335689de] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='64f6036b-99a9-40e4-8963-3cdf66964954',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98843) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 13:49:35.872298 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-d5f093bf-74c6-4655-a665-2eebf176a91e tempest-ServerActionsTestJSON-1981342857 tempest-ServerActionsTestJSON-1981342857-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:49:35.874206 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-d5f093bf-74c6-4655-a665-2eebf176a91e tempest-ServerActionsTestJSON-1981342857 tempest-ServerActionsTestJSON-1981342857-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:49:35.950980 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-d5f093bf-74c6-4655-a665-2eebf176a91e tempest-ServerActionsTestJSON-1981342857 tempest-ServerActionsTestJSON-1981342857-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:49:35.953029 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-d5f093bf-74c6-4655-a665-2eebf176a91e tempest-ServerActionsTestJSON-1981342857 tempest-ServerActionsTestJSON-1981342857-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:49:55.887631 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.manager [None req-ff3633b9-e0ff-49fd-aec5-9eb5ce8997a4 tempest-ServersOnMultiNodesTest-1721415881 tempest-ServersOnMultiNodesTest-1721415881-project] Took 0.51 seconds to select destinations for 1 instance(s). {{(pid=98844) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 13:49:55.921392 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-ff3633b9-e0ff-49fd-aec5-9eb5ce8997a4 tempest-ServersOnMultiNodesTest-1721415881 tempest-ServersOnMultiNodesTest-1721415881-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:49:55.922037 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-ff3633b9-e0ff-49fd-aec5-9eb5ce8997a4 tempest-ServersOnMultiNodesTest-1721415881 tempest-ServersOnMultiNodesTest-1721415881-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:49:56.048336 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-ff3633b9-e0ff-49fd-aec5-9eb5ce8997a4 tempest-ServersOnMultiNodesTest-1721415881 tempest-ServersOnMultiNodesTest-1721415881-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:49:56.048996 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-ff3633b9-e0ff-49fd-aec5-9eb5ce8997a4 tempest-ServersOnMultiNodesTest-1721415881 tempest-ServersOnMultiNodesTest-1721415881-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:49:56.050029 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-ff3633b9-e0ff-49fd-aec5-9eb5ce8997a4 tempest-ServersOnMultiNodesTest-1721415881 tempest-ServersOnMultiNodesTest-1721415881-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:49:56.050592 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-ff3633b9-e0ff-49fd-aec5-9eb5ce8997a4 tempest-ServersOnMultiNodesTest-1721415881 tempest-ServersOnMultiNodesTest-1721415881-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:49:56.081821 n-d-791503-6 nova-conductor[98844]: DEBUG nova.quota [None req-ff3633b9-e0ff-49fd-aec5-9eb5ce8997a4 tempest-ServersOnMultiNodesTest-1721415881 tempest-ServersOnMultiNodesTest-1721415881-project] Getting quotas for project f206ea4609c44a5480b23c9b6034088a. Resources: {'cores', 'ram', 'instances'} {{(pid=98844) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 13:49:56.089621 n-d-791503-6 nova-conductor[98844]: DEBUG nova.quota [None req-ff3633b9-e0ff-49fd-aec5-9eb5ce8997a4 tempest-ServersOnMultiNodesTest-1721415881 tempest-ServersOnMultiNodesTest-1721415881-project] Getting quotas for user ee4a8d9550014104b0ed215b6b097aaf and project f206ea4609c44a5480b23c9b6034088a. Resources: {'cores', 'ram', 'instances'} {{(pid=98844) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 13:49:56.105260 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.manager [None req-ff3633b9-e0ff-49fd-aec5-9eb5ce8997a4 tempest-ServersOnMultiNodesTest-1721415881 tempest-ServersOnMultiNodesTest-1721415881-project] [instance: f8235e4f-daea-4e34-b9c4-2283edd0c2ff] Selected host: n-h2-791503-6; Selected node: n-h2-791503-6; Alternates: [] {{(pid=98844) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 13:49:56.107535 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-ff3633b9-e0ff-49fd-aec5-9eb5ce8997a4 tempest-ServersOnMultiNodesTest-1721415881 tempest-ServersOnMultiNodesTest-1721415881-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:49:56.108156 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-ff3633b9-e0ff-49fd-aec5-9eb5ce8997a4 tempest-ServersOnMultiNodesTest-1721415881 tempest-ServersOnMultiNodesTest-1721415881-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:49:56.118863 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.manager [None req-ff3633b9-e0ff-49fd-aec5-9eb5ce8997a4 tempest-ServersOnMultiNodesTest-1721415881 tempest-ServersOnMultiNodesTest-1721415881-project] [instance: f8235e4f-daea-4e34-b9c4-2283edd0c2ff] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='64f6036b-99a9-40e4-8963-3cdf66964954',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98844) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 13:49:56.121243 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-ff3633b9-e0ff-49fd-aec5-9eb5ce8997a4 tempest-ServersOnMultiNodesTest-1721415881 tempest-ServersOnMultiNodesTest-1721415881-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:49:56.121924 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-ff3633b9-e0ff-49fd-aec5-9eb5ce8997a4 tempest-ServersOnMultiNodesTest-1721415881 tempest-ServersOnMultiNodesTest-1721415881-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:49:56.235000 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-ff3633b9-e0ff-49fd-aec5-9eb5ce8997a4 tempest-ServersOnMultiNodesTest-1721415881 tempest-ServersOnMultiNodesTest-1721415881-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:49:56.235841 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-ff3633b9-e0ff-49fd-aec5-9eb5ce8997a4 tempest-ServersOnMultiNodesTest-1721415881 tempest-ServersOnMultiNodesTest-1721415881-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:50:14.389935 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-bf637a44-5e51-4e70-98f6-01f38e8a1f84 tempest-ServerTagsTestJSON-2122193818 tempest-ServerTagsTestJSON-2122193818-project] Took 0.80 seconds to select destinations for 1 instance(s). {{(pid=98843) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 13:50:14.453860 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-bf637a44-5e51-4e70-98f6-01f38e8a1f84 tempest-ServerTagsTestJSON-2122193818 tempest-ServerTagsTestJSON-2122193818-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:50:14.454801 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-bf637a44-5e51-4e70-98f6-01f38e8a1f84 tempest-ServerTagsTestJSON-2122193818 tempest-ServerTagsTestJSON-2122193818-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:50:14.654670 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-bf637a44-5e51-4e70-98f6-01f38e8a1f84 tempest-ServerTagsTestJSON-2122193818 tempest-ServerTagsTestJSON-2122193818-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:50:14.657785 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-bf637a44-5e51-4e70-98f6-01f38e8a1f84 tempest-ServerTagsTestJSON-2122193818 tempest-ServerTagsTestJSON-2122193818-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:50:14.663867 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-bf637a44-5e51-4e70-98f6-01f38e8a1f84 tempest-ServerTagsTestJSON-2122193818 tempest-ServerTagsTestJSON-2122193818-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:50:14.665293 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-bf637a44-5e51-4e70-98f6-01f38e8a1f84 tempest-ServerTagsTestJSON-2122193818 tempest-ServerTagsTestJSON-2122193818-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:50:14.713600 n-d-791503-6 nova-conductor[98843]: DEBUG nova.quota [None req-bf637a44-5e51-4e70-98f6-01f38e8a1f84 tempest-ServerTagsTestJSON-2122193818 tempest-ServerTagsTestJSON-2122193818-project] Getting quotas for project 2e1ca1434bb443d1a8e107f833e060e4. Resources: {'cores', 'ram', 'instances'} {{(pid=98843) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 13:50:14.727244 n-d-791503-6 nova-conductor[98843]: DEBUG nova.quota [None req-bf637a44-5e51-4e70-98f6-01f38e8a1f84 tempest-ServerTagsTestJSON-2122193818 tempest-ServerTagsTestJSON-2122193818-project] Getting quotas for user 869a1ea7e992427891e57ccc5c0d6607 and project 2e1ca1434bb443d1a8e107f833e060e4. Resources: {'cores', 'ram', 'instances'} {{(pid=98843) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 13:50:14.758024 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-bf637a44-5e51-4e70-98f6-01f38e8a1f84 tempest-ServerTagsTestJSON-2122193818 tempest-ServerTagsTestJSON-2122193818-project] [instance: 50da459f-74f5-42ee-a468-93701e758298] Selected host: n-h2-791503-6; Selected node: n-h2-791503-6; Alternates: [('n-h1-791503-6', 'n-h1-791503-6')] {{(pid=98843) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 13:50:14.760527 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-bf637a44-5e51-4e70-98f6-01f38e8a1f84 tempest-ServerTagsTestJSON-2122193818 tempest-ServerTagsTestJSON-2122193818-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:50:14.763221 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-bf637a44-5e51-4e70-98f6-01f38e8a1f84 tempest-ServerTagsTestJSON-2122193818 tempest-ServerTagsTestJSON-2122193818-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:50:14.782838 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-bf637a44-5e51-4e70-98f6-01f38e8a1f84 tempest-ServerTagsTestJSON-2122193818 tempest-ServerTagsTestJSON-2122193818-project] [instance: 50da459f-74f5-42ee-a468-93701e758298] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='64f6036b-99a9-40e4-8963-3cdf66964954',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98843) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 13:50:14.786681 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-bf637a44-5e51-4e70-98f6-01f38e8a1f84 tempest-ServerTagsTestJSON-2122193818 tempest-ServerTagsTestJSON-2122193818-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:50:14.788231 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-bf637a44-5e51-4e70-98f6-01f38e8a1f84 tempest-ServerTagsTestJSON-2122193818 tempest-ServerTagsTestJSON-2122193818-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:50:14.861083 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-bf637a44-5e51-4e70-98f6-01f38e8a1f84 tempest-ServerTagsTestJSON-2122193818 tempest-ServerTagsTestJSON-2122193818-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:50:14.862634 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-bf637a44-5e51-4e70-98f6-01f38e8a1f84 tempest-ServerTagsTestJSON-2122193818 tempest-ServerTagsTestJSON-2122193818-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:50:15.754943 n-d-791503-6 nova-conductor[98844]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 13:50:21.839540 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.manager [None req-8b577e79-d2d0-4736-813d-4c89a7c8711e tempest-ServerShowV247Test-2136050593 tempest-ServerShowV247Test-2136050593-project] Took 0.86 seconds to select destinations for 1 instance(s). {{(pid=98844) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 13:50:21.895894 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-8b577e79-d2d0-4736-813d-4c89a7c8711e tempest-ServerShowV247Test-2136050593 tempest-ServerShowV247Test-2136050593-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:50:21.896465 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-8b577e79-d2d0-4736-813d-4c89a7c8711e tempest-ServerShowV247Test-2136050593 tempest-ServerShowV247Test-2136050593-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:50:22.034013 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-8b577e79-d2d0-4736-813d-4c89a7c8711e tempest-ServerShowV247Test-2136050593 tempest-ServerShowV247Test-2136050593-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:50:22.034411 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-8b577e79-d2d0-4736-813d-4c89a7c8711e tempest-ServerShowV247Test-2136050593 tempest-ServerShowV247Test-2136050593-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:50:22.037426 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-8b577e79-d2d0-4736-813d-4c89a7c8711e tempest-ServerShowV247Test-2136050593 tempest-ServerShowV247Test-2136050593-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:50:22.039731 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-8b577e79-d2d0-4736-813d-4c89a7c8711e tempest-ServerShowV247Test-2136050593 tempest-ServerShowV247Test-2136050593-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:50:22.090173 n-d-791503-6 nova-conductor[98844]: DEBUG nova.quota [None req-8b577e79-d2d0-4736-813d-4c89a7c8711e tempest-ServerShowV247Test-2136050593 tempest-ServerShowV247Test-2136050593-project] Getting quotas for project bef4d4deea734f91979734871d2204e7. Resources: {'cores', 'ram', 'instances'} {{(pid=98844) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 13:50:22.104057 n-d-791503-6 nova-conductor[98844]: DEBUG nova.quota [None req-8b577e79-d2d0-4736-813d-4c89a7c8711e tempest-ServerShowV247Test-2136050593 tempest-ServerShowV247Test-2136050593-project] Getting quotas for user d6b11135e7d848da91d8dd50a8ff6493 and project bef4d4deea734f91979734871d2204e7. Resources: {'cores', 'ram', 'instances'} {{(pid=98844) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 13:50:22.139989 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.manager [None req-8b577e79-d2d0-4736-813d-4c89a7c8711e tempest-ServerShowV247Test-2136050593 tempest-ServerShowV247Test-2136050593-project] [instance: c9e596d5-c7a5-46be-89f2-e44ac7cbc54a] Selected host: n-h2-791503-6; Selected node: n-h2-791503-6; Alternates: [('n-h1-791503-6', 'n-h1-791503-6')] {{(pid=98844) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 13:50:22.141549 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-8b577e79-d2d0-4736-813d-4c89a7c8711e tempest-ServerShowV247Test-2136050593 tempest-ServerShowV247Test-2136050593-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:50:22.142486 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-8b577e79-d2d0-4736-813d-4c89a7c8711e tempest-ServerShowV247Test-2136050593 tempest-ServerShowV247Test-2136050593-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:50:22.174276 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.manager [None req-8b577e79-d2d0-4736-813d-4c89a7c8711e tempest-ServerShowV247Test-2136050593 tempest-ServerShowV247Test-2136050593-project] [instance: c9e596d5-c7a5-46be-89f2-e44ac7cbc54a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='64f6036b-99a9-40e4-8963-3cdf66964954',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98844) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 13:50:22.176629 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-8b577e79-d2d0-4736-813d-4c89a7c8711e tempest-ServerShowV247Test-2136050593 tempest-ServerShowV247Test-2136050593-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:50:22.177359 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-8b577e79-d2d0-4736-813d-4c89a7c8711e tempest-ServerShowV247Test-2136050593 tempest-ServerShowV247Test-2136050593-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:50:22.281392 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-8b577e79-d2d0-4736-813d-4c89a7c8711e tempest-ServerShowV247Test-2136050593 tempest-ServerShowV247Test-2136050593-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:50:22.282118 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-8b577e79-d2d0-4736-813d-4c89a7c8711e tempest-ServerShowV247Test-2136050593 tempest-ServerShowV247Test-2136050593-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:50:25.544563 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-2304201d-0cd1-45b4-a7b5-102f4e95f989 tempest-ServerActionsTestJSON-1981342857 tempest-ServerActionsTestJSON-1981342857-project] Took 0.77 seconds to select destinations for 1 instance(s). {{(pid=98843) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 13:50:25.645677 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-2304201d-0cd1-45b4-a7b5-102f4e95f989 tempest-ServerActionsTestJSON-1981342857 tempest-ServerActionsTestJSON-1981342857-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:50:25.647925 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-2304201d-0cd1-45b4-a7b5-102f4e95f989 tempest-ServerActionsTestJSON-1981342857 tempest-ServerActionsTestJSON-1981342857-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:50:25.758744 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-2304201d-0cd1-45b4-a7b5-102f4e95f989 tempest-ServerActionsTestJSON-1981342857 tempest-ServerActionsTestJSON-1981342857-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:50:25.759287 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-2304201d-0cd1-45b4-a7b5-102f4e95f989 tempest-ServerActionsTestJSON-1981342857 tempest-ServerActionsTestJSON-1981342857-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:50:25.760126 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-2304201d-0cd1-45b4-a7b5-102f4e95f989 tempest-ServerActionsTestJSON-1981342857 tempest-ServerActionsTestJSON-1981342857-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:50:25.764223 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-2304201d-0cd1-45b4-a7b5-102f4e95f989 tempest-ServerActionsTestJSON-1981342857 tempest-ServerActionsTestJSON-1981342857-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:50:25.810461 n-d-791503-6 nova-conductor[98843]: DEBUG nova.quota [None req-2304201d-0cd1-45b4-a7b5-102f4e95f989 tempest-ServerActionsTestJSON-1981342857 tempest-ServerActionsTestJSON-1981342857-project] Getting quotas for project 5938fa909b2b41f3b9c83d7bed85496e. Resources: {'cores', 'ram', 'instances'} {{(pid=98843) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 13:50:25.816760 n-d-791503-6 nova-conductor[98843]: DEBUG nova.quota [None req-2304201d-0cd1-45b4-a7b5-102f4e95f989 tempest-ServerActionsTestJSON-1981342857 tempest-ServerActionsTestJSON-1981342857-project] Getting quotas for user b0fd2f9f85864877a8044e864e9eed29 and project 5938fa909b2b41f3b9c83d7bed85496e. Resources: {'cores', 'ram', 'instances'} {{(pid=98843) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 13:50:25.843972 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-2304201d-0cd1-45b4-a7b5-102f4e95f989 tempest-ServerActionsTestJSON-1981342857 tempest-ServerActionsTestJSON-1981342857-project] [instance: 060e41d0-99dc-4d9c-ab1d-f190f204b5e8] Selected host: n-h1-791503-6; Selected node: n-h1-791503-6; Alternates: [('n-h2-791503-6', 'n-h2-791503-6')] {{(pid=98843) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 13:50:25.845026 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-2304201d-0cd1-45b4-a7b5-102f4e95f989 tempest-ServerActionsTestJSON-1981342857 tempest-ServerActionsTestJSON-1981342857-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:50:25.845632 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-2304201d-0cd1-45b4-a7b5-102f4e95f989 tempest-ServerActionsTestJSON-1981342857 tempest-ServerActionsTestJSON-1981342857-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:50:25.857137 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-2304201d-0cd1-45b4-a7b5-102f4e95f989 tempest-ServerActionsTestJSON-1981342857 tempest-ServerActionsTestJSON-1981342857-project] [instance: 060e41d0-99dc-4d9c-ab1d-f190f204b5e8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='64f6036b-99a9-40e4-8963-3cdf66964954',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98843) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 13:50:25.859466 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-2304201d-0cd1-45b4-a7b5-102f4e95f989 tempest-ServerActionsTestJSON-1981342857 tempest-ServerActionsTestJSON-1981342857-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:50:25.860854 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-2304201d-0cd1-45b4-a7b5-102f4e95f989 tempest-ServerActionsTestJSON-1981342857 tempest-ServerActionsTestJSON-1981342857-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:50:25.939782 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-2304201d-0cd1-45b4-a7b5-102f4e95f989 tempest-ServerActionsTestJSON-1981342857 tempest-ServerActionsTestJSON-1981342857-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:50:25.940768 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-2304201d-0cd1-45b4-a7b5-102f4e95f989 tempest-ServerActionsTestJSON-1981342857 tempest-ServerActionsTestJSON-1981342857-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:50:29.329120 n-d-791503-6 nova-conductor[98844]: ERROR oslo.messaging._drivers.impl_rabbit [-] [cbd7c90c-b59a-4f8b-992f-d04ba5ad6f9c] AMQP server on 10.222.0.68:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 28 13:50:30.378503 n-d-791503-6 nova-conductor[98844]: INFO oslo.messaging._drivers.impl_rabbit [-] [cbd7c90c-b59a-4f8b-992f-d04ba5ad6f9c] Reconnected to AMQP server on 10.222.0.68:5672 via [amqp] client with port 36492. May 28 13:50:33.290892 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.manager [None req-68b2a956-3b3c-46c3-8ee3-5cd1efecdeff tempest-ServerShowV247Test-2136050593 tempest-ServerShowV247Test-2136050593-project] Took 0.63 seconds to select destinations for 1 instance(s). {{(pid=98844) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 13:50:33.349361 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-68b2a956-3b3c-46c3-8ee3-5cd1efecdeff tempest-ServerShowV247Test-2136050593 tempest-ServerShowV247Test-2136050593-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:50:33.350907 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-68b2a956-3b3c-46c3-8ee3-5cd1efecdeff tempest-ServerShowV247Test-2136050593 tempest-ServerShowV247Test-2136050593-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:50:33.480537 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-68b2a956-3b3c-46c3-8ee3-5cd1efecdeff tempest-ServerShowV247Test-2136050593 tempest-ServerShowV247Test-2136050593-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:50:33.481707 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-68b2a956-3b3c-46c3-8ee3-5cd1efecdeff tempest-ServerShowV247Test-2136050593 tempest-ServerShowV247Test-2136050593-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:50:33.483336 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-68b2a956-3b3c-46c3-8ee3-5cd1efecdeff tempest-ServerShowV247Test-2136050593 tempest-ServerShowV247Test-2136050593-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:50:33.484416 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-68b2a956-3b3c-46c3-8ee3-5cd1efecdeff tempest-ServerShowV247Test-2136050593 tempest-ServerShowV247Test-2136050593-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:50:33.534350 n-d-791503-6 nova-conductor[98844]: DEBUG nova.quota [None req-68b2a956-3b3c-46c3-8ee3-5cd1efecdeff tempest-ServerShowV247Test-2136050593 tempest-ServerShowV247Test-2136050593-project] Getting quotas for project bef4d4deea734f91979734871d2204e7. Resources: {'cores', 'ram', 'instances'} {{(pid=98844) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 13:50:33.561767 n-d-791503-6 nova-conductor[98844]: DEBUG nova.quota [None req-68b2a956-3b3c-46c3-8ee3-5cd1efecdeff tempest-ServerShowV247Test-2136050593 tempest-ServerShowV247Test-2136050593-project] Getting quotas for user d6b11135e7d848da91d8dd50a8ff6493 and project bef4d4deea734f91979734871d2204e7. Resources: {'cores', 'ram', 'instances'} {{(pid=98844) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 13:50:33.620083 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.manager [None req-68b2a956-3b3c-46c3-8ee3-5cd1efecdeff tempest-ServerShowV247Test-2136050593 tempest-ServerShowV247Test-2136050593-project] [instance: 4df916f8-bf82-44c4-ba89-7b617519891b] Selected host: n-h1-791503-6; Selected node: n-h1-791503-6; Alternates: [('n-h2-791503-6', 'n-h2-791503-6')] {{(pid=98844) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 13:50:33.625716 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-68b2a956-3b3c-46c3-8ee3-5cd1efecdeff tempest-ServerShowV247Test-2136050593 tempest-ServerShowV247Test-2136050593-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:50:33.631140 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-68b2a956-3b3c-46c3-8ee3-5cd1efecdeff tempest-ServerShowV247Test-2136050593 tempest-ServerShowV247Test-2136050593-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:50:33.656230 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.manager [None req-68b2a956-3b3c-46c3-8ee3-5cd1efecdeff tempest-ServerShowV247Test-2136050593 tempest-ServerShowV247Test-2136050593-project] [instance: 4df916f8-bf82-44c4-ba89-7b617519891b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='64f6036b-99a9-40e4-8963-3cdf66964954',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98844) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 13:50:33.660871 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-68b2a956-3b3c-46c3-8ee3-5cd1efecdeff tempest-ServerShowV247Test-2136050593 tempest-ServerShowV247Test-2136050593-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:50:33.661943 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-68b2a956-3b3c-46c3-8ee3-5cd1efecdeff tempest-ServerShowV247Test-2136050593 tempest-ServerShowV247Test-2136050593-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:50:33.780512 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-68b2a956-3b3c-46c3-8ee3-5cd1efecdeff tempest-ServerShowV247Test-2136050593 tempest-ServerShowV247Test-2136050593-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:50:33.781718 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-68b2a956-3b3c-46c3-8ee3-5cd1efecdeff tempest-ServerShowV247Test-2136050593 tempest-ServerShowV247Test-2136050593-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:50:47.005796 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-f76e1309-b090-4bb4-ac8d-67f8783473ee tempest-ServerShowV247Test-2136050593 tempest-ServerShowV247Test-2136050593-project] Targeting cell b241212c-c279-4fbb-a1e7-b87889287cbf(cell1) for conductor method rebuild_instance {{(pid=98843) wrapper /opt/stack/nova/nova/conductor/manager.py:91}} May 28 13:50:47.013579 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-f76e1309-b090-4bb4-ac8d-67f8783473ee tempest-ServerShowV247Test-2136050593 tempest-ServerShowV247Test-2136050593-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:50:47.015114 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-f76e1309-b090-4bb4-ac8d-67f8783473ee tempest-ServerShowV247Test-2136050593 tempest-ServerShowV247Test-2136050593-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:50:47.098879 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-f76e1309-b090-4bb4-ac8d-67f8783473ee tempest-ServerShowV247Test-2136050593 tempest-ServerShowV247Test-2136050593-project] [instance: 4df916f8-bf82-44c4-ba89-7b617519891b] No migration record for the rebuild/evacuate request. {{(pid=98843) rebuild_instance /opt/stack/nova/nova/conductor/manager.py:1101}} May 28 13:51:20.926951 n-d-791503-6 nova-conductor[98843]: ERROR oslo.messaging._drivers.impl_rabbit [-] [fb67aa64-250d-4c34-b696-14a5dd0b49b6] AMQP server on 10.222.0.68:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection May 28 13:51:21.992087 n-d-791503-6 nova-conductor[98843]: INFO oslo.messaging._drivers.impl_rabbit [-] [fb67aa64-250d-4c34-b696-14a5dd0b49b6] Reconnected to AMQP server on 10.222.0.68:5672 via [amqp] client with port 37246. May 28 13:51:47.234732 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.manager [None req-bcca1487-02fa-4862-ac33-35646367300d tempest-ServerMetadataNegativeTestJSON-8529091 tempest-ServerMetadataNegativeTestJSON-8529091-project] Took 2.55 seconds to select destinations for 1 instance(s). {{(pid=98844) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 13:51:47.369478 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-bcca1487-02fa-4862-ac33-35646367300d tempest-ServerMetadataNegativeTestJSON-8529091 tempest-ServerMetadataNegativeTestJSON-8529091-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:51:47.377278 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-bcca1487-02fa-4862-ac33-35646367300d tempest-ServerMetadataNegativeTestJSON-8529091 tempest-ServerMetadataNegativeTestJSON-8529091-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:51:47.570578 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-bcca1487-02fa-4862-ac33-35646367300d tempest-ServerMetadataNegativeTestJSON-8529091 tempest-ServerMetadataNegativeTestJSON-8529091-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:51:47.571563 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-bcca1487-02fa-4862-ac33-35646367300d tempest-ServerMetadataNegativeTestJSON-8529091 tempest-ServerMetadataNegativeTestJSON-8529091-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:51:47.576646 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-bcca1487-02fa-4862-ac33-35646367300d tempest-ServerMetadataNegativeTestJSON-8529091 tempest-ServerMetadataNegativeTestJSON-8529091-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:51:47.577521 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-bcca1487-02fa-4862-ac33-35646367300d tempest-ServerMetadataNegativeTestJSON-8529091 tempest-ServerMetadataNegativeTestJSON-8529091-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:51:47.640782 n-d-791503-6 nova-conductor[98844]: DEBUG nova.quota [None req-bcca1487-02fa-4862-ac33-35646367300d tempest-ServerMetadataNegativeTestJSON-8529091 tempest-ServerMetadataNegativeTestJSON-8529091-project] Getting quotas for project c87c420ecb9d4c9b9960ea59598c81f0. Resources: {'cores', 'ram', 'instances'} {{(pid=98844) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 13:51:47.660322 n-d-791503-6 nova-conductor[98844]: DEBUG nova.quota [None req-bcca1487-02fa-4862-ac33-35646367300d tempest-ServerMetadataNegativeTestJSON-8529091 tempest-ServerMetadataNegativeTestJSON-8529091-project] Getting quotas for user 09a888af8b7f427a9a42114acb4624ca and project c87c420ecb9d4c9b9960ea59598c81f0. Resources: {'cores', 'ram', 'instances'} {{(pid=98844) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 13:51:47.703720 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.manager [None req-bcca1487-02fa-4862-ac33-35646367300d tempest-ServerMetadataNegativeTestJSON-8529091 tempest-ServerMetadataNegativeTestJSON-8529091-project] [instance: 9fc1c865-779c-411f-9d16-6edf512c4e4d] Selected host: n-h1-791503-6; Selected node: n-h1-791503-6; Alternates: [('n-h2-791503-6', 'n-h2-791503-6')] {{(pid=98844) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 13:51:47.705819 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-bcca1487-02fa-4862-ac33-35646367300d tempest-ServerMetadataNegativeTestJSON-8529091 tempest-ServerMetadataNegativeTestJSON-8529091-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:51:47.716105 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-bcca1487-02fa-4862-ac33-35646367300d tempest-ServerMetadataNegativeTestJSON-8529091 tempest-ServerMetadataNegativeTestJSON-8529091-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:51:47.732109 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.manager [None req-bcca1487-02fa-4862-ac33-35646367300d tempest-ServerMetadataNegativeTestJSON-8529091 tempest-ServerMetadataNegativeTestJSON-8529091-project] [instance: 9fc1c865-779c-411f-9d16-6edf512c4e4d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='64f6036b-99a9-40e4-8963-3cdf66964954',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98844) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 13:51:47.735262 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-bcca1487-02fa-4862-ac33-35646367300d tempest-ServerMetadataNegativeTestJSON-8529091 tempest-ServerMetadataNegativeTestJSON-8529091-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:51:47.736445 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-bcca1487-02fa-4862-ac33-35646367300d tempest-ServerMetadataNegativeTestJSON-8529091 tempest-ServerMetadataNegativeTestJSON-8529091-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:51:47.845748 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-bcca1487-02fa-4862-ac33-35646367300d tempest-ServerMetadataNegativeTestJSON-8529091 tempest-ServerMetadataNegativeTestJSON-8529091-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:51:47.855487 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-bcca1487-02fa-4862-ac33-35646367300d tempest-ServerMetadataNegativeTestJSON-8529091 tempest-ServerMetadataNegativeTestJSON-8529091-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:52:03.475803 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-13025ab4-d441-4564-a942-a77cd4034201 tempest-ServerDiskConfigTestJSON-1702617594 tempest-ServerDiskConfigTestJSON-1702617594-project] Took 0.75 seconds to select destinations for 1 instance(s). {{(pid=98843) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 13:52:03.509596 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-13025ab4-d441-4564-a942-a77cd4034201 tempest-ServerDiskConfigTestJSON-1702617594 tempest-ServerDiskConfigTestJSON-1702617594-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:52:03.510004 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-13025ab4-d441-4564-a942-a77cd4034201 tempest-ServerDiskConfigTestJSON-1702617594 tempest-ServerDiskConfigTestJSON-1702617594-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:52:03.583627 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-13025ab4-d441-4564-a942-a77cd4034201 tempest-ServerDiskConfigTestJSON-1702617594 tempest-ServerDiskConfigTestJSON-1702617594-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:52:03.584396 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-13025ab4-d441-4564-a942-a77cd4034201 tempest-ServerDiskConfigTestJSON-1702617594 tempest-ServerDiskConfigTestJSON-1702617594-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:52:03.585379 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-13025ab4-d441-4564-a942-a77cd4034201 tempest-ServerDiskConfigTestJSON-1702617594 tempest-ServerDiskConfigTestJSON-1702617594-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:52:03.585936 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-13025ab4-d441-4564-a942-a77cd4034201 tempest-ServerDiskConfigTestJSON-1702617594 tempest-ServerDiskConfigTestJSON-1702617594-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:52:03.607704 n-d-791503-6 nova-conductor[98843]: DEBUG nova.quota [None req-13025ab4-d441-4564-a942-a77cd4034201 tempest-ServerDiskConfigTestJSON-1702617594 tempest-ServerDiskConfigTestJSON-1702617594-project] Getting quotas for project ba430fd922bc421fb14113883cd64d97. Resources: {'cores', 'ram', 'instances'} {{(pid=98843) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 13:52:03.613875 n-d-791503-6 nova-conductor[98843]: DEBUG nova.quota [None req-13025ab4-d441-4564-a942-a77cd4034201 tempest-ServerDiskConfigTestJSON-1702617594 tempest-ServerDiskConfigTestJSON-1702617594-project] Getting quotas for user 5e14f8391c7a4db3a9aba78e41a35d34 and project ba430fd922bc421fb14113883cd64d97. Resources: {'cores', 'ram', 'instances'} {{(pid=98843) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 13:52:03.629287 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-13025ab4-d441-4564-a942-a77cd4034201 tempest-ServerDiskConfigTestJSON-1702617594 tempest-ServerDiskConfigTestJSON-1702617594-project] [instance: a9da8f5f-ce78-4451-852f-f30080fa6740] Selected host: n-h2-791503-6; Selected node: n-h2-791503-6; Alternates: [('n-h1-791503-6', 'n-h1-791503-6')] {{(pid=98843) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 13:52:03.630897 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-13025ab4-d441-4564-a942-a77cd4034201 tempest-ServerDiskConfigTestJSON-1702617594 tempest-ServerDiskConfigTestJSON-1702617594-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:52:03.631517 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-13025ab4-d441-4564-a942-a77cd4034201 tempest-ServerDiskConfigTestJSON-1702617594 tempest-ServerDiskConfigTestJSON-1702617594-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:52:03.644012 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-13025ab4-d441-4564-a942-a77cd4034201 tempest-ServerDiskConfigTestJSON-1702617594 tempest-ServerDiskConfigTestJSON-1702617594-project] [instance: a9da8f5f-ce78-4451-852f-f30080fa6740] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='64f6036b-99a9-40e4-8963-3cdf66964954',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98843) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 13:52:03.645864 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-13025ab4-d441-4564-a942-a77cd4034201 tempest-ServerDiskConfigTestJSON-1702617594 tempest-ServerDiskConfigTestJSON-1702617594-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:52:03.646490 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-13025ab4-d441-4564-a942-a77cd4034201 tempest-ServerDiskConfigTestJSON-1702617594 tempest-ServerDiskConfigTestJSON-1702617594-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:52:03.700038 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-13025ab4-d441-4564-a942-a77cd4034201 tempest-ServerDiskConfigTestJSON-1702617594 tempest-ServerDiskConfigTestJSON-1702617594-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:52:03.701447 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-13025ab4-d441-4564-a942-a77cd4034201 tempest-ServerDiskConfigTestJSON-1702617594 tempest-ServerDiskConfigTestJSON-1702617594-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:52:12.840564 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.manager [None req-55ef49fa-dcd0-4be4-9dca-add965b93775 tempest-TaggedBootDevicesTest_v242-1066635340 tempest-TaggedBootDevicesTest_v242-1066635340-project] Took 0.50 seconds to select destinations for 1 instance(s). {{(pid=98844) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 13:52:12.898291 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-55ef49fa-dcd0-4be4-9dca-add965b93775 tempest-TaggedBootDevicesTest_v242-1066635340 tempest-TaggedBootDevicesTest_v242-1066635340-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:52:12.899376 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-55ef49fa-dcd0-4be4-9dca-add965b93775 tempest-TaggedBootDevicesTest_v242-1066635340 tempest-TaggedBootDevicesTest_v242-1066635340-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:52:13.013353 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-55ef49fa-dcd0-4be4-9dca-add965b93775 tempest-TaggedBootDevicesTest_v242-1066635340 tempest-TaggedBootDevicesTest_v242-1066635340-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:52:13.013353 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-55ef49fa-dcd0-4be4-9dca-add965b93775 tempest-TaggedBootDevicesTest_v242-1066635340 tempest-TaggedBootDevicesTest_v242-1066635340-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:52:13.013353 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-55ef49fa-dcd0-4be4-9dca-add965b93775 tempest-TaggedBootDevicesTest_v242-1066635340 tempest-TaggedBootDevicesTest_v242-1066635340-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:52:13.014131 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-55ef49fa-dcd0-4be4-9dca-add965b93775 tempest-TaggedBootDevicesTest_v242-1066635340 tempest-TaggedBootDevicesTest_v242-1066635340-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:52:13.049149 n-d-791503-6 nova-conductor[98844]: DEBUG nova.quota [None req-55ef49fa-dcd0-4be4-9dca-add965b93775 tempest-TaggedBootDevicesTest_v242-1066635340 tempest-TaggedBootDevicesTest_v242-1066635340-project] Getting quotas for project 1e5296c0462d49a092c96041f01dbdc7. Resources: {'cores', 'ram', 'instances'} {{(pid=98844) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 13:52:13.059219 n-d-791503-6 nova-conductor[98844]: DEBUG nova.quota [None req-55ef49fa-dcd0-4be4-9dca-add965b93775 tempest-TaggedBootDevicesTest_v242-1066635340 tempest-TaggedBootDevicesTest_v242-1066635340-project] Getting quotas for user cd725c3decfc49be8d998cf9d282fdfd and project 1e5296c0462d49a092c96041f01dbdc7. Resources: {'cores', 'ram', 'instances'} {{(pid=98844) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 13:52:13.080253 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.manager [None req-55ef49fa-dcd0-4be4-9dca-add965b93775 tempest-TaggedBootDevicesTest_v242-1066635340 tempest-TaggedBootDevicesTest_v242-1066635340-project] [instance: e7f9e623-e0ff-40de-9b39-7edfe45cd504] Selected host: n-h1-791503-6; Selected node: n-h1-791503-6; Alternates: [('n-h2-791503-6', 'n-h2-791503-6')] {{(pid=98844) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 13:52:13.081738 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-55ef49fa-dcd0-4be4-9dca-add965b93775 tempest-TaggedBootDevicesTest_v242-1066635340 tempest-TaggedBootDevicesTest_v242-1066635340-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:52:13.082385 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-55ef49fa-dcd0-4be4-9dca-add965b93775 tempest-TaggedBootDevicesTest_v242-1066635340 tempest-TaggedBootDevicesTest_v242-1066635340-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:52:13.098697 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.manager [None req-55ef49fa-dcd0-4be4-9dca-add965b93775 tempest-TaggedBootDevicesTest_v242-1066635340 tempest-TaggedBootDevicesTest_v242-1066635340-project] [instance: e7f9e623-e0ff-40de-9b39-7edfe45cd504] block_device_mapping [BlockDeviceMapping(attachment_id=70d1db61-3880-4726-863b-cd41430edcdd,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='1e2c6f33-702b-4844-8a7c-582f50b20c70',volume_size=1,volume_type=None), BlockDeviceMapping(attachment_id=ea2b1246-6292-4be7-b6cb-32648a684520,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='16745aae-9010-43b0-8c98-ec23e4a2d1e8',volume_size=1,volume_type=None), BlockDeviceMapping(attachment_id=01f7a71f-26f3-4b97-9c1c-f73551a5218b,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='52450811-20ea-4f4a-892f-57331e26d3ba',volume_size=1,volume_type=None)] {{(pid=98844) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 13:52:13.109856 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-55ef49fa-dcd0-4be4-9dca-add965b93775 tempest-TaggedBootDevicesTest_v242-1066635340 tempest-TaggedBootDevicesTest_v242-1066635340-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:52:13.111019 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-55ef49fa-dcd0-4be4-9dca-add965b93775 tempest-TaggedBootDevicesTest_v242-1066635340 tempest-TaggedBootDevicesTest_v242-1066635340-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:52:13.129536 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-55ef49fa-dcd0-4be4-9dca-add965b93775 tempest-TaggedBootDevicesTest_v242-1066635340 tempest-TaggedBootDevicesTest_v242-1066635340-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:52:13.130874 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-55ef49fa-dcd0-4be4-9dca-add965b93775 tempest-TaggedBootDevicesTest_v242-1066635340 tempest-TaggedBootDevicesTest_v242-1066635340-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:52:13.150029 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-55ef49fa-dcd0-4be4-9dca-add965b93775 tempest-TaggedBootDevicesTest_v242-1066635340 tempest-TaggedBootDevicesTest_v242-1066635340-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:52:13.151257 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-55ef49fa-dcd0-4be4-9dca-add965b93775 tempest-TaggedBootDevicesTest_v242-1066635340 tempest-TaggedBootDevicesTest_v242-1066635340-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:52:13.242120 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-55ef49fa-dcd0-4be4-9dca-add965b93775 tempest-TaggedBootDevicesTest_v242-1066635340 tempest-TaggedBootDevicesTest_v242-1066635340-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:52:13.243594 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-55ef49fa-dcd0-4be4-9dca-add965b93775 tempest-TaggedBootDevicesTest_v242-1066635340 tempest-TaggedBootDevicesTest_v242-1066635340-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:52:24.441203 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-1396020b-28fc-4bbd-9227-0eae5964efee tempest-ServerDiskConfigTestJSON-1702617594 tempest-ServerDiskConfigTestJSON-1702617594-project] Targeting cell b241212c-c279-4fbb-a1e7-b87889287cbf(cell1) for conductor method rebuild_instance {{(pid=98843) wrapper /opt/stack/nova/nova/conductor/manager.py:91}} May 28 13:52:24.442985 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-1396020b-28fc-4bbd-9227-0eae5964efee tempest-ServerDiskConfigTestJSON-1702617594 tempest-ServerDiskConfigTestJSON-1702617594-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:52:24.444449 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-1396020b-28fc-4bbd-9227-0eae5964efee tempest-ServerDiskConfigTestJSON-1702617594 tempest-ServerDiskConfigTestJSON-1702617594-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:52:24.507412 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-1396020b-28fc-4bbd-9227-0eae5964efee tempest-ServerDiskConfigTestJSON-1702617594 tempest-ServerDiskConfigTestJSON-1702617594-project] [instance: a9da8f5f-ce78-4451-852f-f30080fa6740] No migration record for the rebuild/evacuate request. {{(pid=98843) rebuild_instance /opt/stack/nova/nova/conductor/manager.py:1101}} May 28 13:52:53.170124 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.manager [None req-038d49b4-6607-4bc3-b373-d7d22073f553 tempest-ServerShowV254Test-300138123 tempest-ServerShowV254Test-300138123-project] Took 0.59 seconds to select destinations for 1 instance(s). {{(pid=98844) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 13:52:53.200629 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-038d49b4-6607-4bc3-b373-d7d22073f553 tempest-ServerShowV254Test-300138123 tempest-ServerShowV254Test-300138123-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:52:53.201440 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-038d49b4-6607-4bc3-b373-d7d22073f553 tempest-ServerShowV254Test-300138123 tempest-ServerShowV254Test-300138123-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:52:53.268702 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-038d49b4-6607-4bc3-b373-d7d22073f553 tempest-ServerShowV254Test-300138123 tempest-ServerShowV254Test-300138123-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:52:53.269425 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-038d49b4-6607-4bc3-b373-d7d22073f553 tempest-ServerShowV254Test-300138123 tempest-ServerShowV254Test-300138123-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:52:53.270406 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-038d49b4-6607-4bc3-b373-d7d22073f553 tempest-ServerShowV254Test-300138123 tempest-ServerShowV254Test-300138123-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:52:53.271011 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-038d49b4-6607-4bc3-b373-d7d22073f553 tempest-ServerShowV254Test-300138123 tempest-ServerShowV254Test-300138123-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:52:53.299478 n-d-791503-6 nova-conductor[98844]: DEBUG nova.quota [None req-038d49b4-6607-4bc3-b373-d7d22073f553 tempest-ServerShowV254Test-300138123 tempest-ServerShowV254Test-300138123-project] Getting quotas for project eb672a63574446d380bf847dfc4786a5. Resources: {'cores', 'ram', 'instances'} {{(pid=98844) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 13:52:53.308667 n-d-791503-6 nova-conductor[98844]: DEBUG nova.quota [None req-038d49b4-6607-4bc3-b373-d7d22073f553 tempest-ServerShowV254Test-300138123 tempest-ServerShowV254Test-300138123-project] Getting quotas for user becac61278ef4febac93f40479076ede and project eb672a63574446d380bf847dfc4786a5. Resources: {'cores', 'ram', 'instances'} {{(pid=98844) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 13:52:53.324269 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.manager [None req-038d49b4-6607-4bc3-b373-d7d22073f553 tempest-ServerShowV254Test-300138123 tempest-ServerShowV254Test-300138123-project] [instance: 4a174b2d-e584-45d4-8a31-5fb9505914de] Selected host: n-h2-791503-6; Selected node: n-h2-791503-6; Alternates: [('n-h1-791503-6', 'n-h1-791503-6')] {{(pid=98844) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 13:52:53.325684 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-038d49b4-6607-4bc3-b373-d7d22073f553 tempest-ServerShowV254Test-300138123 tempest-ServerShowV254Test-300138123-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:52:53.326366 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-038d49b4-6607-4bc3-b373-d7d22073f553 tempest-ServerShowV254Test-300138123 tempest-ServerShowV254Test-300138123-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:52:53.337758 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.manager [None req-038d49b4-6607-4bc3-b373-d7d22073f553 tempest-ServerShowV254Test-300138123 tempest-ServerShowV254Test-300138123-project] [instance: 4a174b2d-e584-45d4-8a31-5fb9505914de] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='64f6036b-99a9-40e4-8963-3cdf66964954',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98844) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 13:52:53.339221 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-038d49b4-6607-4bc3-b373-d7d22073f553 tempest-ServerShowV254Test-300138123 tempest-ServerShowV254Test-300138123-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:52:53.339721 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-038d49b4-6607-4bc3-b373-d7d22073f553 tempest-ServerShowV254Test-300138123 tempest-ServerShowV254Test-300138123-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:52:53.405439 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-038d49b4-6607-4bc3-b373-d7d22073f553 tempest-ServerShowV254Test-300138123 tempest-ServerShowV254Test-300138123-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:52:53.405847 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-038d49b4-6607-4bc3-b373-d7d22073f553 tempest-ServerShowV254Test-300138123 tempest-ServerShowV254Test-300138123-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:53:00.407913 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-e1e68bf7-4c26-4258-96bc-d09a19eecf2b tempest-ServerShowV254Test-300138123 tempest-ServerShowV254Test-300138123-project] Targeting cell b241212c-c279-4fbb-a1e7-b87889287cbf(cell1) for conductor method rebuild_instance {{(pid=98843) wrapper /opt/stack/nova/nova/conductor/manager.py:91}} May 28 13:53:00.409070 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-e1e68bf7-4c26-4258-96bc-d09a19eecf2b tempest-ServerShowV254Test-300138123 tempest-ServerShowV254Test-300138123-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:53:00.409704 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-e1e68bf7-4c26-4258-96bc-d09a19eecf2b tempest-ServerShowV254Test-300138123 tempest-ServerShowV254Test-300138123-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:53:00.449945 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-e1e68bf7-4c26-4258-96bc-d09a19eecf2b tempest-ServerShowV254Test-300138123 tempest-ServerShowV254Test-300138123-project] [instance: 4a174b2d-e584-45d4-8a31-5fb9505914de] No migration record for the rebuild/evacuate request. {{(pid=98843) rebuild_instance /opt/stack/nova/nova/conductor/manager.py:1101}} May 28 13:53:13.215791 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.manager [None req-eceab55e-38e7-4038-b287-fc70a9a6b5dc tempest-ServerDiskConfigTestJSON-1702617594 tempest-ServerDiskConfigTestJSON-1702617594-project] Took 0.82 seconds to select destinations for 1 instance(s). {{(pid=98844) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 13:53:13.326002 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-eceab55e-38e7-4038-b287-fc70a9a6b5dc tempest-ServerDiskConfigTestJSON-1702617594 tempest-ServerDiskConfigTestJSON-1702617594-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:53:13.326789 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-eceab55e-38e7-4038-b287-fc70a9a6b5dc tempest-ServerDiskConfigTestJSON-1702617594 tempest-ServerDiskConfigTestJSON-1702617594-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:53:13.534381 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-eceab55e-38e7-4038-b287-fc70a9a6b5dc tempest-ServerDiskConfigTestJSON-1702617594 tempest-ServerDiskConfigTestJSON-1702617594-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:53:13.535023 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-eceab55e-38e7-4038-b287-fc70a9a6b5dc tempest-ServerDiskConfigTestJSON-1702617594 tempest-ServerDiskConfigTestJSON-1702617594-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:53:13.536248 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-eceab55e-38e7-4038-b287-fc70a9a6b5dc tempest-ServerDiskConfigTestJSON-1702617594 tempest-ServerDiskConfigTestJSON-1702617594-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:53:13.536889 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-eceab55e-38e7-4038-b287-fc70a9a6b5dc tempest-ServerDiskConfigTestJSON-1702617594 tempest-ServerDiskConfigTestJSON-1702617594-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:53:13.626243 n-d-791503-6 nova-conductor[98844]: DEBUG nova.quota [None req-eceab55e-38e7-4038-b287-fc70a9a6b5dc tempest-ServerDiskConfigTestJSON-1702617594 tempest-ServerDiskConfigTestJSON-1702617594-project] Getting quotas for project ba430fd922bc421fb14113883cd64d97. Resources: {'cores', 'ram', 'instances'} {{(pid=98844) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 13:53:13.649081 n-d-791503-6 nova-conductor[98844]: DEBUG nova.quota [None req-eceab55e-38e7-4038-b287-fc70a9a6b5dc tempest-ServerDiskConfigTestJSON-1702617594 tempest-ServerDiskConfigTestJSON-1702617594-project] Getting quotas for user 5e14f8391c7a4db3a9aba78e41a35d34 and project ba430fd922bc421fb14113883cd64d97. Resources: {'cores', 'ram', 'instances'} {{(pid=98844) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 13:53:13.695322 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.manager [None req-eceab55e-38e7-4038-b287-fc70a9a6b5dc tempest-ServerDiskConfigTestJSON-1702617594 tempest-ServerDiskConfigTestJSON-1702617594-project] [instance: a26d1e62-3aed-4cf1-aefc-ffcb886c851d] Selected host: n-h1-791503-6; Selected node: n-h1-791503-6; Alternates: [('n-h2-791503-6', 'n-h2-791503-6')] {{(pid=98844) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 13:53:13.699109 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-eceab55e-38e7-4038-b287-fc70a9a6b5dc tempest-ServerDiskConfigTestJSON-1702617594 tempest-ServerDiskConfigTestJSON-1702617594-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:53:13.699732 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-eceab55e-38e7-4038-b287-fc70a9a6b5dc tempest-ServerDiskConfigTestJSON-1702617594 tempest-ServerDiskConfigTestJSON-1702617594-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:53:13.722544 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.manager [None req-eceab55e-38e7-4038-b287-fc70a9a6b5dc tempest-ServerDiskConfigTestJSON-1702617594 tempest-ServerDiskConfigTestJSON-1702617594-project] [instance: a26d1e62-3aed-4cf1-aefc-ffcb886c851d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='64f6036b-99a9-40e4-8963-3cdf66964954',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98844) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 13:53:13.724253 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-eceab55e-38e7-4038-b287-fc70a9a6b5dc tempest-ServerDiskConfigTestJSON-1702617594 tempest-ServerDiskConfigTestJSON-1702617594-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:53:13.724809 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-eceab55e-38e7-4038-b287-fc70a9a6b5dc tempest-ServerDiskConfigTestJSON-1702617594 tempest-ServerDiskConfigTestJSON-1702617594-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:53:13.802093 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-eceab55e-38e7-4038-b287-fc70a9a6b5dc tempest-ServerDiskConfigTestJSON-1702617594 tempest-ServerDiskConfigTestJSON-1702617594-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:53:13.802627 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-eceab55e-38e7-4038-b287-fc70a9a6b5dc tempest-ServerDiskConfigTestJSON-1702617594 tempest-ServerDiskConfigTestJSON-1702617594-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:53:30.375770 n-d-791503-6 nova-conductor[98844]: ERROR oslo.messaging._drivers.impl_rabbit [-] [cbd7c90c-b59a-4f8b-992f-d04ba5ad6f9c] AMQP server on 10.222.0.68:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection May 28 13:53:31.447846 n-d-791503-6 nova-conductor[98844]: INFO oslo.messaging._drivers.impl_rabbit [-] [cbd7c90c-b59a-4f8b-992f-d04ba5ad6f9c] Reconnected to AMQP server on 10.222.0.68:5672 via [amqp] client with port 40070. May 28 13:53:35.793335 n-d-791503-6 nova-conductor[98844]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 13:53:55.449909 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-4f1ec2bd-67e8-48b6-a85b-e5e516625c7b tempest-ServerDiskConfigTestJSON-1702617594 tempest-ServerDiskConfigTestJSON-1702617594-project] Targeting cell b241212c-c279-4fbb-a1e7-b87889287cbf(cell1) for conductor method rebuild_instance {{(pid=98843) wrapper /opt/stack/nova/nova/conductor/manager.py:91}} May 28 13:53:55.450520 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-4f1ec2bd-67e8-48b6-a85b-e5e516625c7b tempest-ServerDiskConfigTestJSON-1702617594 tempest-ServerDiskConfigTestJSON-1702617594-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:53:55.453265 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-4f1ec2bd-67e8-48b6-a85b-e5e516625c7b tempest-ServerDiskConfigTestJSON-1702617594 tempest-ServerDiskConfigTestJSON-1702617594-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:53:55.495263 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-4f1ec2bd-67e8-48b6-a85b-e5e516625c7b tempest-ServerDiskConfigTestJSON-1702617594 tempest-ServerDiskConfigTestJSON-1702617594-project] [instance: a26d1e62-3aed-4cf1-aefc-ffcb886c851d] No migration record for the rebuild/evacuate request. {{(pid=98843) rebuild_instance /opt/stack/nova/nova/conductor/manager.py:1101}} May 28 13:54:21.744666 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.manager [None req-70450157-cbff-46c0-aa39-fede2e9906d5 tempest-ServersTestJSON-522644002 tempest-ServersTestJSON-522644002-project] Took 0.56 seconds to select destinations for 1 instance(s). {{(pid=98844) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 13:54:21.816917 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-70450157-cbff-46c0-aa39-fede2e9906d5 tempest-ServersTestJSON-522644002 tempest-ServersTestJSON-522644002-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:54:21.818044 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-70450157-cbff-46c0-aa39-fede2e9906d5 tempest-ServersTestJSON-522644002 tempest-ServersTestJSON-522644002-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:54:21.975524 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-70450157-cbff-46c0-aa39-fede2e9906d5 tempest-ServersTestJSON-522644002 tempest-ServersTestJSON-522644002-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:54:21.977554 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-70450157-cbff-46c0-aa39-fede2e9906d5 tempest-ServersTestJSON-522644002 tempest-ServersTestJSON-522644002-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:54:21.979779 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-70450157-cbff-46c0-aa39-fede2e9906d5 tempest-ServersTestJSON-522644002 tempest-ServersTestJSON-522644002-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:54:21.980793 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-70450157-cbff-46c0-aa39-fede2e9906d5 tempest-ServersTestJSON-522644002 tempest-ServersTestJSON-522644002-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:54:21.992753 n-d-791503-6 nova-conductor[98843]: ERROR oslo.messaging._drivers.impl_rabbit [-] [fb67aa64-250d-4c34-b696-14a5dd0b49b6] AMQP server on 10.222.0.68:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 28 13:54:22.065632 n-d-791503-6 nova-conductor[98844]: DEBUG nova.quota [None req-70450157-cbff-46c0-aa39-fede2e9906d5 tempest-ServersTestJSON-522644002 tempest-ServersTestJSON-522644002-project] Getting quotas for project efd57ddb22474391b21578fc1f778df1. Resources: {'cores', 'ram', 'instances'} {{(pid=98844) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 13:54:22.083385 n-d-791503-6 nova-conductor[98844]: DEBUG nova.quota [None req-70450157-cbff-46c0-aa39-fede2e9906d5 tempest-ServersTestJSON-522644002 tempest-ServersTestJSON-522644002-project] Getting quotas for user d1d60de6e49c40dbb897be0eca327528 and project efd57ddb22474391b21578fc1f778df1. Resources: {'cores', 'ram', 'instances'} {{(pid=98844) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 13:54:22.117799 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.manager [None req-70450157-cbff-46c0-aa39-fede2e9906d5 tempest-ServersTestJSON-522644002 tempest-ServersTestJSON-522644002-project] [instance: b3ec3671-cd99-433d-889a-e3592e7ddce4] Selected host: n-h2-791503-6; Selected node: n-h2-791503-6; Alternates: [('n-h1-791503-6', 'n-h1-791503-6')] {{(pid=98844) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 13:54:22.122433 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-70450157-cbff-46c0-aa39-fede2e9906d5 tempest-ServersTestJSON-522644002 tempest-ServersTestJSON-522644002-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:54:22.123934 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-70450157-cbff-46c0-aa39-fede2e9906d5 tempest-ServersTestJSON-522644002 tempest-ServersTestJSON-522644002-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:54:22.141655 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.manager [None req-70450157-cbff-46c0-aa39-fede2e9906d5 tempest-ServersTestJSON-522644002 tempest-ServersTestJSON-522644002-project] [instance: b3ec3671-cd99-433d-889a-e3592e7ddce4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='64f6036b-99a9-40e4-8963-3cdf66964954',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98844) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 13:54:22.148572 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-70450157-cbff-46c0-aa39-fede2e9906d5 tempest-ServersTestJSON-522644002 tempest-ServersTestJSON-522644002-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:54:22.150514 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-70450157-cbff-46c0-aa39-fede2e9906d5 tempest-ServersTestJSON-522644002 tempest-ServersTestJSON-522644002-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:54:22.226644 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-70450157-cbff-46c0-aa39-fede2e9906d5 tempest-ServersTestJSON-522644002 tempest-ServersTestJSON-522644002-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:54:22.227420 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-70450157-cbff-46c0-aa39-fede2e9906d5 tempest-ServersTestJSON-522644002 tempest-ServersTestJSON-522644002-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:54:23.022760 n-d-791503-6 nova-conductor[98843]: INFO oslo.messaging._drivers.impl_rabbit [-] [fb67aa64-250d-4c34-b696-14a5dd0b49b6] Reconnected to AMQP server on 10.222.0.68:5672 via [amqp] client with port 41060. May 28 13:54:30.580102 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-ca50face-e7fb-4a4a-a6f7-ce9b40aa9652 tempest-ServerDiskConfigTestJSON-1702617594 tempest-ServerDiskConfigTestJSON-1702617594-project] Took 0.56 seconds to select destinations for 1 instance(s). {{(pid=98843) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 13:54:30.635713 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-ca50face-e7fb-4a4a-a6f7-ce9b40aa9652 tempest-ServerDiskConfigTestJSON-1702617594 tempest-ServerDiskConfigTestJSON-1702617594-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:54:30.636036 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-ca50face-e7fb-4a4a-a6f7-ce9b40aa9652 tempest-ServerDiskConfigTestJSON-1702617594 tempest-ServerDiskConfigTestJSON-1702617594-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:54:30.737594 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-ca50face-e7fb-4a4a-a6f7-ce9b40aa9652 tempest-ServerDiskConfigTestJSON-1702617594 tempest-ServerDiskConfigTestJSON-1702617594-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:54:30.739586 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-ca50face-e7fb-4a4a-a6f7-ce9b40aa9652 tempest-ServerDiskConfigTestJSON-1702617594 tempest-ServerDiskConfigTestJSON-1702617594-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:54:30.740703 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-ca50face-e7fb-4a4a-a6f7-ce9b40aa9652 tempest-ServerDiskConfigTestJSON-1702617594 tempest-ServerDiskConfigTestJSON-1702617594-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:54:30.741283 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-ca50face-e7fb-4a4a-a6f7-ce9b40aa9652 tempest-ServerDiskConfigTestJSON-1702617594 tempest-ServerDiskConfigTestJSON-1702617594-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:54:30.768283 n-d-791503-6 nova-conductor[98843]: DEBUG nova.quota [None req-ca50face-e7fb-4a4a-a6f7-ce9b40aa9652 tempest-ServerDiskConfigTestJSON-1702617594 tempest-ServerDiskConfigTestJSON-1702617594-project] Getting quotas for project ba430fd922bc421fb14113883cd64d97. Resources: {'cores', 'ram', 'instances'} {{(pid=98843) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 13:54:30.774721 n-d-791503-6 nova-conductor[98843]: DEBUG nova.quota [None req-ca50face-e7fb-4a4a-a6f7-ce9b40aa9652 tempest-ServerDiskConfigTestJSON-1702617594 tempest-ServerDiskConfigTestJSON-1702617594-project] Getting quotas for user 5e14f8391c7a4db3a9aba78e41a35d34 and project ba430fd922bc421fb14113883cd64d97. Resources: {'cores', 'ram', 'instances'} {{(pid=98843) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 13:54:30.791327 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-ca50face-e7fb-4a4a-a6f7-ce9b40aa9652 tempest-ServerDiskConfigTestJSON-1702617594 tempest-ServerDiskConfigTestJSON-1702617594-project] [instance: 5f72de54-4de4-49cc-9450-92352e51d1b1] Selected host: n-h2-791503-6; Selected node: n-h2-791503-6; Alternates: [('n-h1-791503-6', 'n-h1-791503-6')] {{(pid=98843) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 13:54:30.792699 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-ca50face-e7fb-4a4a-a6f7-ce9b40aa9652 tempest-ServerDiskConfigTestJSON-1702617594 tempest-ServerDiskConfigTestJSON-1702617594-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:54:30.793279 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-ca50face-e7fb-4a4a-a6f7-ce9b40aa9652 tempest-ServerDiskConfigTestJSON-1702617594 tempest-ServerDiskConfigTestJSON-1702617594-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:54:30.804789 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-ca50face-e7fb-4a4a-a6f7-ce9b40aa9652 tempest-ServerDiskConfigTestJSON-1702617594 tempest-ServerDiskConfigTestJSON-1702617594-project] [instance: 5f72de54-4de4-49cc-9450-92352e51d1b1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='64f6036b-99a9-40e4-8963-3cdf66964954',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98843) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 13:54:30.806661 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-ca50face-e7fb-4a4a-a6f7-ce9b40aa9652 tempest-ServerDiskConfigTestJSON-1702617594 tempest-ServerDiskConfigTestJSON-1702617594-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:54:30.807880 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-ca50face-e7fb-4a4a-a6f7-ce9b40aa9652 tempest-ServerDiskConfigTestJSON-1702617594 tempest-ServerDiskConfigTestJSON-1702617594-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:54:30.873422 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-ca50face-e7fb-4a4a-a6f7-ce9b40aa9652 tempest-ServerDiskConfigTestJSON-1702617594 tempest-ServerDiskConfigTestJSON-1702617594-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:54:30.874437 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-ca50face-e7fb-4a4a-a6f7-ce9b40aa9652 tempest-ServerDiskConfigTestJSON-1702617594 tempest-ServerDiskConfigTestJSON-1702617594-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:54:35.015592 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.manager [None req-1b842043-05d8-4d36-bdf4-d0d122b2eb36 tempest-ServerAddressesNegativeTestJSON-811416831 tempest-ServerAddressesNegativeTestJSON-811416831-project] Took 0.75 seconds to select destinations for 1 instance(s). {{(pid=98844) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 13:54:35.165417 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-1b842043-05d8-4d36-bdf4-d0d122b2eb36 tempest-ServerAddressesNegativeTestJSON-811416831 tempest-ServerAddressesNegativeTestJSON-811416831-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:54:35.168377 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-1b842043-05d8-4d36-bdf4-d0d122b2eb36 tempest-ServerAddressesNegativeTestJSON-811416831 tempest-ServerAddressesNegativeTestJSON-811416831-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:54:35.413047 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-1b842043-05d8-4d36-bdf4-d0d122b2eb36 tempest-ServerAddressesNegativeTestJSON-811416831 tempest-ServerAddressesNegativeTestJSON-811416831-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:54:35.413825 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-1b842043-05d8-4d36-bdf4-d0d122b2eb36 tempest-ServerAddressesNegativeTestJSON-811416831 tempest-ServerAddressesNegativeTestJSON-811416831-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:54:35.418576 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-1b842043-05d8-4d36-bdf4-d0d122b2eb36 tempest-ServerAddressesNegativeTestJSON-811416831 tempest-ServerAddressesNegativeTestJSON-811416831-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:54:35.422306 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-1b842043-05d8-4d36-bdf4-d0d122b2eb36 tempest-ServerAddressesNegativeTestJSON-811416831 tempest-ServerAddressesNegativeTestJSON-811416831-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:54:35.509858 n-d-791503-6 nova-conductor[98844]: DEBUG nova.quota [None req-1b842043-05d8-4d36-bdf4-d0d122b2eb36 tempest-ServerAddressesNegativeTestJSON-811416831 tempest-ServerAddressesNegativeTestJSON-811416831-project] Getting quotas for project c0017771f66540fbaf548aea9db3575f. Resources: {'cores', 'ram', 'instances'} {{(pid=98844) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 13:54:35.537512 n-d-791503-6 nova-conductor[98844]: DEBUG nova.quota [None req-1b842043-05d8-4d36-bdf4-d0d122b2eb36 tempest-ServerAddressesNegativeTestJSON-811416831 tempest-ServerAddressesNegativeTestJSON-811416831-project] Getting quotas for user 32c595c1d2524210b8cd7b1abbb85fe2 and project c0017771f66540fbaf548aea9db3575f. Resources: {'cores', 'ram', 'instances'} {{(pid=98844) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 13:54:35.597286 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.manager [None req-1b842043-05d8-4d36-bdf4-d0d122b2eb36 tempest-ServerAddressesNegativeTestJSON-811416831 tempest-ServerAddressesNegativeTestJSON-811416831-project] [instance: a4bcfc65-87ca-4912-874d-95ec10c46cc1] Selected host: n-h1-791503-6; Selected node: n-h1-791503-6; Alternates: [('n-h2-791503-6', 'n-h2-791503-6')] {{(pid=98844) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 13:54:35.601516 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-1b842043-05d8-4d36-bdf4-d0d122b2eb36 tempest-ServerAddressesNegativeTestJSON-811416831 tempest-ServerAddressesNegativeTestJSON-811416831-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:54:35.606377 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-1b842043-05d8-4d36-bdf4-d0d122b2eb36 tempest-ServerAddressesNegativeTestJSON-811416831 tempest-ServerAddressesNegativeTestJSON-811416831-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:54:35.632504 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.manager [None req-1b842043-05d8-4d36-bdf4-d0d122b2eb36 tempest-ServerAddressesNegativeTestJSON-811416831 tempest-ServerAddressesNegativeTestJSON-811416831-project] [instance: a4bcfc65-87ca-4912-874d-95ec10c46cc1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='64f6036b-99a9-40e4-8963-3cdf66964954',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98844) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 13:54:35.634712 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-1b842043-05d8-4d36-bdf4-d0d122b2eb36 tempest-ServerAddressesNegativeTestJSON-811416831 tempest-ServerAddressesNegativeTestJSON-811416831-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:54:35.635388 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-1b842043-05d8-4d36-bdf4-d0d122b2eb36 tempest-ServerAddressesNegativeTestJSON-811416831 tempest-ServerAddressesNegativeTestJSON-811416831-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:54:35.730572 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-1b842043-05d8-4d36-bdf4-d0d122b2eb36 tempest-ServerAddressesNegativeTestJSON-811416831 tempest-ServerAddressesNegativeTestJSON-811416831-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:54:35.731267 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-1b842043-05d8-4d36-bdf4-d0d122b2eb36 tempest-ServerAddressesNegativeTestJSON-811416831 tempest-ServerAddressesNegativeTestJSON-811416831-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:55:17.546613 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-3768faee-f837-4f93-848c-1e21586d001d tempest-ServerShowV257Test-50679545 tempest-ServerShowV257Test-50679545-project] Took 0.47 seconds to select destinations for 1 instance(s). {{(pid=98843) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 13:55:17.596595 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-3768faee-f837-4f93-848c-1e21586d001d tempest-ServerShowV257Test-50679545 tempest-ServerShowV257Test-50679545-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:55:17.598119 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-3768faee-f837-4f93-848c-1e21586d001d tempest-ServerShowV257Test-50679545 tempest-ServerShowV257Test-50679545-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:55:17.707374 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-3768faee-f837-4f93-848c-1e21586d001d tempest-ServerShowV257Test-50679545 tempest-ServerShowV257Test-50679545-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:55:17.708469 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-3768faee-f837-4f93-848c-1e21586d001d tempest-ServerShowV257Test-50679545 tempest-ServerShowV257Test-50679545-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:55:17.709693 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-3768faee-f837-4f93-848c-1e21586d001d tempest-ServerShowV257Test-50679545 tempest-ServerShowV257Test-50679545-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:55:17.710634 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-3768faee-f837-4f93-848c-1e21586d001d tempest-ServerShowV257Test-50679545 tempest-ServerShowV257Test-50679545-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:55:17.741692 n-d-791503-6 nova-conductor[98843]: DEBUG nova.quota [None req-3768faee-f837-4f93-848c-1e21586d001d tempest-ServerShowV257Test-50679545 tempest-ServerShowV257Test-50679545-project] Getting quotas for project bb095a9bc88847e0968e7d133c4797ba. Resources: {'cores', 'ram', 'instances'} {{(pid=98843) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 13:55:17.751919 n-d-791503-6 nova-conductor[98843]: DEBUG nova.quota [None req-3768faee-f837-4f93-848c-1e21586d001d tempest-ServerShowV257Test-50679545 tempest-ServerShowV257Test-50679545-project] Getting quotas for user d41cb9ee14144a9c8757fedce9ac9448 and project bb095a9bc88847e0968e7d133c4797ba. Resources: {'cores', 'ram', 'instances'} {{(pid=98843) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 13:55:17.782240 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-3768faee-f837-4f93-848c-1e21586d001d tempest-ServerShowV257Test-50679545 tempest-ServerShowV257Test-50679545-project] [instance: 3d3881f3-dbd8-48e4-a99c-041a61b3a262] Selected host: n-h1-791503-6; Selected node: n-h1-791503-6; Alternates: [('n-h2-791503-6', 'n-h2-791503-6')] {{(pid=98843) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 13:55:17.784249 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-3768faee-f837-4f93-848c-1e21586d001d tempest-ServerShowV257Test-50679545 tempest-ServerShowV257Test-50679545-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:55:17.785578 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-3768faee-f837-4f93-848c-1e21586d001d tempest-ServerShowV257Test-50679545 tempest-ServerShowV257Test-50679545-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:55:17.799910 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-3768faee-f837-4f93-848c-1e21586d001d tempest-ServerShowV257Test-50679545 tempest-ServerShowV257Test-50679545-project] [instance: 3d3881f3-dbd8-48e4-a99c-041a61b3a262] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='64f6036b-99a9-40e4-8963-3cdf66964954',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98843) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 13:55:17.803174 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-3768faee-f837-4f93-848c-1e21586d001d tempest-ServerShowV257Test-50679545 tempest-ServerShowV257Test-50679545-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:55:17.804675 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-3768faee-f837-4f93-848c-1e21586d001d tempest-ServerShowV257Test-50679545 tempest-ServerShowV257Test-50679545-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:55:17.862481 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-3768faee-f837-4f93-848c-1e21586d001d tempest-ServerShowV257Test-50679545 tempest-ServerShowV257Test-50679545-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:55:17.863572 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-3768faee-f837-4f93-848c-1e21586d001d tempest-ServerShowV257Test-50679545 tempest-ServerShowV257Test-50679545-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:55:26.595496 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-c95fe93e-6181-4b30-8a63-209b45475c65 tempest-ServerShowV257Test-50679545 tempest-ServerShowV257Test-50679545-project] Targeting cell b241212c-c279-4fbb-a1e7-b87889287cbf(cell1) for conductor method rebuild_instance {{(pid=98843) wrapper /opt/stack/nova/nova/conductor/manager.py:91}} May 28 13:55:26.599721 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-c95fe93e-6181-4b30-8a63-209b45475c65 tempest-ServerShowV257Test-50679545 tempest-ServerShowV257Test-50679545-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:55:26.600426 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-c95fe93e-6181-4b30-8a63-209b45475c65 tempest-ServerShowV257Test-50679545 tempest-ServerShowV257Test-50679545-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:55:26.647550 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-c95fe93e-6181-4b30-8a63-209b45475c65 tempest-ServerShowV257Test-50679545 tempest-ServerShowV257Test-50679545-project] [instance: 3d3881f3-dbd8-48e4-a99c-041a61b3a262] No migration record for the rebuild/evacuate request. {{(pid=98843) rebuild_instance /opt/stack/nova/nova/conductor/manager.py:1101}} May 28 13:55:26.937948 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.manager [None req-750438f4-5ee3-438a-a77f-97bf18284b32 tempest-ServerAddressesTestJSON-1219851022 tempest-ServerAddressesTestJSON-1219851022-project] Took 0.68 seconds to select destinations for 1 instance(s). {{(pid=98844) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 13:55:27.028894 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-750438f4-5ee3-438a-a77f-97bf18284b32 tempest-ServerAddressesTestJSON-1219851022 tempest-ServerAddressesTestJSON-1219851022-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:55:27.029429 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-750438f4-5ee3-438a-a77f-97bf18284b32 tempest-ServerAddressesTestJSON-1219851022 tempest-ServerAddressesTestJSON-1219851022-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:55:27.170724 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-750438f4-5ee3-438a-a77f-97bf18284b32 tempest-ServerAddressesTestJSON-1219851022 tempest-ServerAddressesTestJSON-1219851022-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:55:27.171222 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-750438f4-5ee3-438a-a77f-97bf18284b32 tempest-ServerAddressesTestJSON-1219851022 tempest-ServerAddressesTestJSON-1219851022-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:55:27.172143 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-750438f4-5ee3-438a-a77f-97bf18284b32 tempest-ServerAddressesTestJSON-1219851022 tempest-ServerAddressesTestJSON-1219851022-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:55:27.172550 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-750438f4-5ee3-438a-a77f-97bf18284b32 tempest-ServerAddressesTestJSON-1219851022 tempest-ServerAddressesTestJSON-1219851022-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:55:27.196252 n-d-791503-6 nova-conductor[98844]: DEBUG nova.quota [None req-750438f4-5ee3-438a-a77f-97bf18284b32 tempest-ServerAddressesTestJSON-1219851022 tempest-ServerAddressesTestJSON-1219851022-project] Getting quotas for project e45d48c8a2fc4201a934c09badb62fef. Resources: {'cores', 'ram', 'instances'} {{(pid=98844) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 13:55:27.204605 n-d-791503-6 nova-conductor[98844]: DEBUG nova.quota [None req-750438f4-5ee3-438a-a77f-97bf18284b32 tempest-ServerAddressesTestJSON-1219851022 tempest-ServerAddressesTestJSON-1219851022-project] Getting quotas for user c7223af4297f41b7b0b589f7a0cd10ea and project e45d48c8a2fc4201a934c09badb62fef. Resources: {'cores', 'ram', 'instances'} {{(pid=98844) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 13:55:27.219339 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.manager [None req-750438f4-5ee3-438a-a77f-97bf18284b32 tempest-ServerAddressesTestJSON-1219851022 tempest-ServerAddressesTestJSON-1219851022-project] [instance: dec5c1e5-7308-4ea7-be1a-062123e2d924] Selected host: n-h2-791503-6; Selected node: n-h2-791503-6; Alternates: [('n-h1-791503-6', 'n-h1-791503-6')] {{(pid=98844) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 13:55:27.220915 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-750438f4-5ee3-438a-a77f-97bf18284b32 tempest-ServerAddressesTestJSON-1219851022 tempest-ServerAddressesTestJSON-1219851022-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:55:27.221542 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-750438f4-5ee3-438a-a77f-97bf18284b32 tempest-ServerAddressesTestJSON-1219851022 tempest-ServerAddressesTestJSON-1219851022-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:55:27.242602 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.manager [None req-750438f4-5ee3-438a-a77f-97bf18284b32 tempest-ServerAddressesTestJSON-1219851022 tempest-ServerAddressesTestJSON-1219851022-project] [instance: dec5c1e5-7308-4ea7-be1a-062123e2d924] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='64f6036b-99a9-40e4-8963-3cdf66964954',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98844) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 13:55:27.244462 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-750438f4-5ee3-438a-a77f-97bf18284b32 tempest-ServerAddressesTestJSON-1219851022 tempest-ServerAddressesTestJSON-1219851022-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:55:27.245347 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-750438f4-5ee3-438a-a77f-97bf18284b32 tempest-ServerAddressesTestJSON-1219851022 tempest-ServerAddressesTestJSON-1219851022-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:55:27.306625 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-750438f4-5ee3-438a-a77f-97bf18284b32 tempest-ServerAddressesTestJSON-1219851022 tempest-ServerAddressesTestJSON-1219851022-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:55:27.307537 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-750438f4-5ee3-438a-a77f-97bf18284b32 tempest-ServerAddressesTestJSON-1219851022 tempest-ServerAddressesTestJSON-1219851022-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:56:13.311934 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.manager [None req-e3e1c05a-40a3-4a5a-a88d-a2aceb108a52 tempest-ServerPasswordTestJSON-1093486023 tempest-ServerPasswordTestJSON-1093486023-project] Took 0.45 seconds to select destinations for 1 instance(s). {{(pid=98844) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 13:56:13.347329 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-e3e1c05a-40a3-4a5a-a88d-a2aceb108a52 tempest-ServerPasswordTestJSON-1093486023 tempest-ServerPasswordTestJSON-1093486023-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:56:13.348048 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-e3e1c05a-40a3-4a5a-a88d-a2aceb108a52 tempest-ServerPasswordTestJSON-1093486023 tempest-ServerPasswordTestJSON-1093486023-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:56:13.492075 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-e3e1c05a-40a3-4a5a-a88d-a2aceb108a52 tempest-ServerPasswordTestJSON-1093486023 tempest-ServerPasswordTestJSON-1093486023-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:56:13.492795 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-e3e1c05a-40a3-4a5a-a88d-a2aceb108a52 tempest-ServerPasswordTestJSON-1093486023 tempest-ServerPasswordTestJSON-1093486023-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:56:13.494436 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-e3e1c05a-40a3-4a5a-a88d-a2aceb108a52 tempest-ServerPasswordTestJSON-1093486023 tempest-ServerPasswordTestJSON-1093486023-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:56:13.495140 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-e3e1c05a-40a3-4a5a-a88d-a2aceb108a52 tempest-ServerPasswordTestJSON-1093486023 tempest-ServerPasswordTestJSON-1093486023-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:56:13.555359 n-d-791503-6 nova-conductor[98844]: DEBUG nova.quota [None req-e3e1c05a-40a3-4a5a-a88d-a2aceb108a52 tempest-ServerPasswordTestJSON-1093486023 tempest-ServerPasswordTestJSON-1093486023-project] Getting quotas for project 74ebef1e655c405a8fdee3b034f17b42. Resources: {'cores', 'ram', 'instances'} {{(pid=98844) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 13:56:13.571496 n-d-791503-6 nova-conductor[98844]: DEBUG nova.quota [None req-e3e1c05a-40a3-4a5a-a88d-a2aceb108a52 tempest-ServerPasswordTestJSON-1093486023 tempest-ServerPasswordTestJSON-1093486023-project] Getting quotas for user f515a7ecb7b74f019374d5eafcc628cd and project 74ebef1e655c405a8fdee3b034f17b42. Resources: {'cores', 'ram', 'instances'} {{(pid=98844) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 13:56:13.604649 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.manager [None req-e3e1c05a-40a3-4a5a-a88d-a2aceb108a52 tempest-ServerPasswordTestJSON-1093486023 tempest-ServerPasswordTestJSON-1093486023-project] [instance: 24bccce1-42b2-4092-98a7-a7ca02596280] Selected host: n-h1-791503-6; Selected node: n-h1-791503-6; Alternates: [('n-h2-791503-6', 'n-h2-791503-6')] {{(pid=98844) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 13:56:13.605700 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-e3e1c05a-40a3-4a5a-a88d-a2aceb108a52 tempest-ServerPasswordTestJSON-1093486023 tempest-ServerPasswordTestJSON-1093486023-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:56:13.606185 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-e3e1c05a-40a3-4a5a-a88d-a2aceb108a52 tempest-ServerPasswordTestJSON-1093486023 tempest-ServerPasswordTestJSON-1093486023-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:56:13.617627 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.manager [None req-e3e1c05a-40a3-4a5a-a88d-a2aceb108a52 tempest-ServerPasswordTestJSON-1093486023 tempest-ServerPasswordTestJSON-1093486023-project] [instance: 24bccce1-42b2-4092-98a7-a7ca02596280] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='64f6036b-99a9-40e4-8963-3cdf66964954',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98844) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 13:56:13.619737 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-e3e1c05a-40a3-4a5a-a88d-a2aceb108a52 tempest-ServerPasswordTestJSON-1093486023 tempest-ServerPasswordTestJSON-1093486023-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:56:13.620231 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-e3e1c05a-40a3-4a5a-a88d-a2aceb108a52 tempest-ServerPasswordTestJSON-1093486023 tempest-ServerPasswordTestJSON-1093486023-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:56:13.664306 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-e3e1c05a-40a3-4a5a-a88d-a2aceb108a52 tempest-ServerPasswordTestJSON-1093486023 tempest-ServerPasswordTestJSON-1093486023-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:56:13.664806 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-e3e1c05a-40a3-4a5a-a88d-a2aceb108a52 tempest-ServerPasswordTestJSON-1093486023 tempest-ServerPasswordTestJSON-1093486023-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:56:31.440088 n-d-791503-6 nova-conductor[98844]: ERROR oslo.messaging._drivers.impl_rabbit [-] [cbd7c90c-b59a-4f8b-992f-d04ba5ad6f9c] AMQP server on 10.222.0.68:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection May 28 13:56:32.466800 n-d-791503-6 nova-conductor[98844]: INFO oslo.messaging._drivers.impl_rabbit [-] [cbd7c90c-b59a-4f8b-992f-d04ba5ad6f9c] Reconnected to AMQP server on 10.222.0.68:5672 via [amqp] client with port 44510. May 28 13:56:55.850492 n-d-791503-6 nova-conductor[98844]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 13:56:59.634074 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-6cae49a6-5edb-4462-94b7-5480115a78c5 tempest-AttachVolumeTestJSON-597064669 tempest-AttachVolumeTestJSON-597064669-project] Took 1.11 seconds to select destinations for 1 instance(s). {{(pid=98843) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 13:56:59.661144 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-6cae49a6-5edb-4462-94b7-5480115a78c5 tempest-AttachVolumeTestJSON-597064669 tempest-AttachVolumeTestJSON-597064669-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:56:59.661557 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-6cae49a6-5edb-4462-94b7-5480115a78c5 tempest-AttachVolumeTestJSON-597064669 tempest-AttachVolumeTestJSON-597064669-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:56:59.745771 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-6cae49a6-5edb-4462-94b7-5480115a78c5 tempest-AttachVolumeTestJSON-597064669 tempest-AttachVolumeTestJSON-597064669-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:56:59.746201 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-6cae49a6-5edb-4462-94b7-5480115a78c5 tempest-AttachVolumeTestJSON-597064669 tempest-AttachVolumeTestJSON-597064669-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:56:59.746953 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-6cae49a6-5edb-4462-94b7-5480115a78c5 tempest-AttachVolumeTestJSON-597064669 tempest-AttachVolumeTestJSON-597064669-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:56:59.747402 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-6cae49a6-5edb-4462-94b7-5480115a78c5 tempest-AttachVolumeTestJSON-597064669 tempest-AttachVolumeTestJSON-597064669-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:56:59.784994 n-d-791503-6 nova-conductor[98843]: DEBUG nova.quota [None req-6cae49a6-5edb-4462-94b7-5480115a78c5 tempest-AttachVolumeTestJSON-597064669 tempest-AttachVolumeTestJSON-597064669-project] Getting quotas for project c48213e39e0b467480207de2e5ad171e. Resources: {'cores', 'ram', 'instances'} {{(pid=98843) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 13:56:59.791622 n-d-791503-6 nova-conductor[98843]: DEBUG nova.quota [None req-6cae49a6-5edb-4462-94b7-5480115a78c5 tempest-AttachVolumeTestJSON-597064669 tempest-AttachVolumeTestJSON-597064669-project] Getting quotas for user 46bb534bc526423c80a6e85b97cf3155 and project c48213e39e0b467480207de2e5ad171e. Resources: {'cores', 'ram', 'instances'} {{(pid=98843) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 13:56:59.806934 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-6cae49a6-5edb-4462-94b7-5480115a78c5 tempest-AttachVolumeTestJSON-597064669 tempest-AttachVolumeTestJSON-597064669-project] [instance: 472ef86d-a760-472e-a066-da3d5b8c9a24] Selected host: n-h2-791503-6; Selected node: n-h2-791503-6; Alternates: [('n-h1-791503-6', 'n-h1-791503-6')] {{(pid=98843) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 13:56:59.808321 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-6cae49a6-5edb-4462-94b7-5480115a78c5 tempest-AttachVolumeTestJSON-597064669 tempest-AttachVolumeTestJSON-597064669-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:56:59.808891 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-6cae49a6-5edb-4462-94b7-5480115a78c5 tempest-AttachVolumeTestJSON-597064669 tempest-AttachVolumeTestJSON-597064669-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:56:59.818345 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-6cae49a6-5edb-4462-94b7-5480115a78c5 tempest-AttachVolumeTestJSON-597064669 tempest-AttachVolumeTestJSON-597064669-project] [instance: 472ef86d-a760-472e-a066-da3d5b8c9a24] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='64f6036b-99a9-40e4-8963-3cdf66964954',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98843) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 13:56:59.819762 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-6cae49a6-5edb-4462-94b7-5480115a78c5 tempest-AttachVolumeTestJSON-597064669 tempest-AttachVolumeTestJSON-597064669-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:56:59.820492 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-6cae49a6-5edb-4462-94b7-5480115a78c5 tempest-AttachVolumeTestJSON-597064669 tempest-AttachVolumeTestJSON-597064669-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:56:59.886368 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-6cae49a6-5edb-4462-94b7-5480115a78c5 tempest-AttachVolumeTestJSON-597064669 tempest-AttachVolumeTestJSON-597064669-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:56:59.888439 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-6cae49a6-5edb-4462-94b7-5480115a78c5 tempest-AttachVolumeTestJSON-597064669 tempest-AttachVolumeTestJSON-597064669-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:57:17.846951 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.manager [None req-b4823a1f-a068-4d9b-8a27-1e48a68a4784 tempest-ServersTestJSON-1383685549 tempest-ServersTestJSON-1383685549-project] Took 0.42 seconds to select destinations for 1 instance(s). {{(pid=98844) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 13:57:17.897884 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-b4823a1f-a068-4d9b-8a27-1e48a68a4784 tempest-ServersTestJSON-1383685549 tempest-ServersTestJSON-1383685549-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:57:17.901386 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-b4823a1f-a068-4d9b-8a27-1e48a68a4784 tempest-ServersTestJSON-1383685549 tempest-ServersTestJSON-1383685549-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:57:18.055996 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-b4823a1f-a068-4d9b-8a27-1e48a68a4784 tempest-ServersTestJSON-1383685549 tempest-ServersTestJSON-1383685549-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:57:18.057220 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-b4823a1f-a068-4d9b-8a27-1e48a68a4784 tempest-ServersTestJSON-1383685549 tempest-ServersTestJSON-1383685549-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:57:18.059119 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-b4823a1f-a068-4d9b-8a27-1e48a68a4784 tempest-ServersTestJSON-1383685549 tempest-ServersTestJSON-1383685549-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:57:18.060555 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-b4823a1f-a068-4d9b-8a27-1e48a68a4784 tempest-ServersTestJSON-1383685549 tempest-ServersTestJSON-1383685549-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:57:18.102451 n-d-791503-6 nova-conductor[98844]: DEBUG nova.quota [None req-b4823a1f-a068-4d9b-8a27-1e48a68a4784 tempest-ServersTestJSON-1383685549 tempest-ServersTestJSON-1383685549-project] Getting quotas for project 4c8b6e6cc7d94c65bf92abe84d7118a5. Resources: {'cores', 'ram', 'instances'} {{(pid=98844) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 13:57:18.117850 n-d-791503-6 nova-conductor[98844]: DEBUG nova.quota [None req-b4823a1f-a068-4d9b-8a27-1e48a68a4784 tempest-ServersTestJSON-1383685549 tempest-ServersTestJSON-1383685549-project] Getting quotas for user 25da8d9566e7447a928740418a2ecb1f and project 4c8b6e6cc7d94c65bf92abe84d7118a5. Resources: {'cores', 'ram', 'instances'} {{(pid=98844) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 13:57:18.144972 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.manager [None req-b4823a1f-a068-4d9b-8a27-1e48a68a4784 tempest-ServersTestJSON-1383685549 tempest-ServersTestJSON-1383685549-project] [instance: b3f67d98-1944-47f4-937c-cf895ca0593f] Selected host: n-h1-791503-6; Selected node: n-h1-791503-6; Alternates: [('n-h2-791503-6', 'n-h2-791503-6')] {{(pid=98844) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 13:57:18.148571 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-b4823a1f-a068-4d9b-8a27-1e48a68a4784 tempest-ServersTestJSON-1383685549 tempest-ServersTestJSON-1383685549-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:57:18.149987 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-b4823a1f-a068-4d9b-8a27-1e48a68a4784 tempest-ServersTestJSON-1383685549 tempest-ServersTestJSON-1383685549-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:57:18.170072 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.manager [None req-b4823a1f-a068-4d9b-8a27-1e48a68a4784 tempest-ServersTestJSON-1383685549 tempest-ServersTestJSON-1383685549-project] [instance: b3f67d98-1944-47f4-937c-cf895ca0593f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='64f6036b-99a9-40e4-8963-3cdf66964954',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98844) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 13:57:18.174657 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-b4823a1f-a068-4d9b-8a27-1e48a68a4784 tempest-ServersTestJSON-1383685549 tempest-ServersTestJSON-1383685549-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:57:18.175565 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-b4823a1f-a068-4d9b-8a27-1e48a68a4784 tempest-ServersTestJSON-1383685549 tempest-ServersTestJSON-1383685549-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:57:18.288327 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-b4823a1f-a068-4d9b-8a27-1e48a68a4784 tempest-ServersTestJSON-1383685549 tempest-ServersTestJSON-1383685549-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:57:18.289086 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-b4823a1f-a068-4d9b-8a27-1e48a68a4784 tempest-ServersTestJSON-1383685549 tempest-ServersTestJSON-1383685549-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:57:23.026812 n-d-791503-6 nova-conductor[98843]: ERROR oslo.messaging._drivers.impl_rabbit [-] [fb67aa64-250d-4c34-b696-14a5dd0b49b6] AMQP server on 10.222.0.68:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection May 28 13:57:24.080385 n-d-791503-6 nova-conductor[98843]: INFO oslo.messaging._drivers.impl_rabbit [-] [fb67aa64-250d-4c34-b696-14a5dd0b49b6] Reconnected to AMQP server on 10.222.0.68:5672 via [amqp] client with port 45178. May 28 13:57:38.691870 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-7707a365-9820-4d4e-b4ef-3c95672ded01 tempest-DeleteServersTestJSON-444271794 tempest-DeleteServersTestJSON-444271794-project] Took 0.44 seconds to select destinations for 1 instance(s). {{(pid=98843) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 13:57:38.740389 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-7707a365-9820-4d4e-b4ef-3c95672ded01 tempest-DeleteServersTestJSON-444271794 tempest-DeleteServersTestJSON-444271794-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:57:38.741294 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-7707a365-9820-4d4e-b4ef-3c95672ded01 tempest-DeleteServersTestJSON-444271794 tempest-DeleteServersTestJSON-444271794-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:57:38.819379 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-7707a365-9820-4d4e-b4ef-3c95672ded01 tempest-DeleteServersTestJSON-444271794 tempest-DeleteServersTestJSON-444271794-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:57:38.820201 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-7707a365-9820-4d4e-b4ef-3c95672ded01 tempest-DeleteServersTestJSON-444271794 tempest-DeleteServersTestJSON-444271794-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:57:38.821760 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-7707a365-9820-4d4e-b4ef-3c95672ded01 tempest-DeleteServersTestJSON-444271794 tempest-DeleteServersTestJSON-444271794-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:57:38.822710 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-7707a365-9820-4d4e-b4ef-3c95672ded01 tempest-DeleteServersTestJSON-444271794 tempest-DeleteServersTestJSON-444271794-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:57:38.847447 n-d-791503-6 nova-conductor[98843]: DEBUG nova.quota [None req-7707a365-9820-4d4e-b4ef-3c95672ded01 tempest-DeleteServersTestJSON-444271794 tempest-DeleteServersTestJSON-444271794-project] Getting quotas for project effef6608bf4456ba198f8c88d5856db. Resources: {'cores', 'ram', 'instances'} {{(pid=98843) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 13:57:38.855830 n-d-791503-6 nova-conductor[98843]: DEBUG nova.quota [None req-7707a365-9820-4d4e-b4ef-3c95672ded01 tempest-DeleteServersTestJSON-444271794 tempest-DeleteServersTestJSON-444271794-project] Getting quotas for user 1cfa7b7d864e4213a312ba664434a79b and project effef6608bf4456ba198f8c88d5856db. Resources: {'cores', 'ram', 'instances'} {{(pid=98843) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 13:57:38.875835 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-7707a365-9820-4d4e-b4ef-3c95672ded01 tempest-DeleteServersTestJSON-444271794 tempest-DeleteServersTestJSON-444271794-project] [instance: 53cb302f-2f0f-4b92-81ae-c0341b5b34ba] Selected host: n-h2-791503-6; Selected node: n-h2-791503-6; Alternates: [('n-h1-791503-6', 'n-h1-791503-6')] {{(pid=98843) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 13:57:38.877269 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-7707a365-9820-4d4e-b4ef-3c95672ded01 tempest-DeleteServersTestJSON-444271794 tempest-DeleteServersTestJSON-444271794-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:57:38.879811 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-7707a365-9820-4d4e-b4ef-3c95672ded01 tempest-DeleteServersTestJSON-444271794 tempest-DeleteServersTestJSON-444271794-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:57:38.891506 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-7707a365-9820-4d4e-b4ef-3c95672ded01 tempest-DeleteServersTestJSON-444271794 tempest-DeleteServersTestJSON-444271794-project] [instance: 53cb302f-2f0f-4b92-81ae-c0341b5b34ba] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='64f6036b-99a9-40e4-8963-3cdf66964954',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98843) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 13:57:38.895647 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-7707a365-9820-4d4e-b4ef-3c95672ded01 tempest-DeleteServersTestJSON-444271794 tempest-DeleteServersTestJSON-444271794-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:57:38.896882 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-7707a365-9820-4d4e-b4ef-3c95672ded01 tempest-DeleteServersTestJSON-444271794 tempest-DeleteServersTestJSON-444271794-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:57:38.969796 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-7707a365-9820-4d4e-b4ef-3c95672ded01 tempest-DeleteServersTestJSON-444271794 tempest-DeleteServersTestJSON-444271794-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:57:38.970361 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-7707a365-9820-4d4e-b4ef-3c95672ded01 tempest-DeleteServersTestJSON-444271794 tempest-DeleteServersTestJSON-444271794-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:57:50.576168 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.manager [None req-7aff282f-7604-4362-aa2d-c471e32bd8ed tempest-ServersTestJSON-1383685549 tempest-ServersTestJSON-1383685549-project] Took 0.60 seconds to select destinations for 1 instance(s). {{(pid=98844) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 13:57:50.629976 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.manager [None req-7aff282f-7604-4362-aa2d-c471e32bd8ed tempest-ServersTestJSON-1383685549 tempest-ServersTestJSON-1383685549-project] [instance: c2096fb0-4461-44cf-b489-408370f05e3b] While scheduling instance, the build request was already deleted. {{(pid=98844) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1572}} May 28 13:57:51.201613 n-d-791503-6 nova-conductor[98844]: INFO nova.scheduler.client.report [None req-7aff282f-7604-4362-aa2d-c471e32bd8ed tempest-ServersTestJSON-1383685549 tempest-ServersTestJSON-1383685549-project] Deleted allocation for instance c2096fb0-4461-44cf-b489-408370f05e3b May 28 13:57:51.232968 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-7aff282f-7604-4362-aa2d-c471e32bd8ed tempest-ServersTestJSON-1383685549 tempest-ServersTestJSON-1383685549-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:57:51.236536 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-7aff282f-7604-4362-aa2d-c471e32bd8ed tempest-ServersTestJSON-1383685549 tempest-ServersTestJSON-1383685549-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:57:51.240414 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-7aff282f-7604-4362-aa2d-c471e32bd8ed tempest-ServersTestJSON-1383685549 tempest-ServersTestJSON-1383685549-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:57:51.242499 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-7aff282f-7604-4362-aa2d-c471e32bd8ed tempest-ServersTestJSON-1383685549 tempest-ServersTestJSON-1383685549-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:57:51.297065 n-d-791503-6 nova-conductor[98844]: DEBUG nova.quota [None req-7aff282f-7604-4362-aa2d-c471e32bd8ed tempest-ServersTestJSON-1383685549 tempest-ServersTestJSON-1383685549-project] Getting quotas for project 4c8b6e6cc7d94c65bf92abe84d7118a5. Resources: {'cores', 'ram', 'instances'} {{(pid=98844) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 13:57:51.302594 n-d-791503-6 nova-conductor[98844]: DEBUG nova.quota [None req-7aff282f-7604-4362-aa2d-c471e32bd8ed tempest-ServersTestJSON-1383685549 tempest-ServersTestJSON-1383685549-project] Getting quotas for user 25da8d9566e7447a928740418a2ecb1f and project 4c8b6e6cc7d94c65bf92abe84d7118a5. Resources: {'cores', 'ram', 'instances'} {{(pid=98844) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 13:57:55.152333 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-e5f3520f-b469-4a9e-95f5-b71fb72b13fe tempest-ServersTestJSON-1383685549 tempest-ServersTestJSON-1383685549-project] Took 0.63 seconds to select destinations for 1 instance(s). {{(pid=98843) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 13:57:55.208338 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-e5f3520f-b469-4a9e-95f5-b71fb72b13fe tempest-ServersTestJSON-1383685549 tempest-ServersTestJSON-1383685549-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:57:55.209880 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-e5f3520f-b469-4a9e-95f5-b71fb72b13fe tempest-ServersTestJSON-1383685549 tempest-ServersTestJSON-1383685549-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:57:55.303779 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-e5f3520f-b469-4a9e-95f5-b71fb72b13fe tempest-ServersTestJSON-1383685549 tempest-ServersTestJSON-1383685549-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:57:55.304705 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-e5f3520f-b469-4a9e-95f5-b71fb72b13fe tempest-ServersTestJSON-1383685549 tempest-ServersTestJSON-1383685549-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:57:55.305999 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-e5f3520f-b469-4a9e-95f5-b71fb72b13fe tempest-ServersTestJSON-1383685549 tempest-ServersTestJSON-1383685549-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:57:55.306759 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-e5f3520f-b469-4a9e-95f5-b71fb72b13fe tempest-ServersTestJSON-1383685549 tempest-ServersTestJSON-1383685549-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:57:55.344979 n-d-791503-6 nova-conductor[98843]: DEBUG nova.quota [None req-e5f3520f-b469-4a9e-95f5-b71fb72b13fe tempest-ServersTestJSON-1383685549 tempest-ServersTestJSON-1383685549-project] Getting quotas for project 4c8b6e6cc7d94c65bf92abe84d7118a5. Resources: {'cores', 'ram', 'instances'} {{(pid=98843) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 13:57:55.357906 n-d-791503-6 nova-conductor[98843]: DEBUG nova.quota [None req-e5f3520f-b469-4a9e-95f5-b71fb72b13fe tempest-ServersTestJSON-1383685549 tempest-ServersTestJSON-1383685549-project] Getting quotas for user 25da8d9566e7447a928740418a2ecb1f and project 4c8b6e6cc7d94c65bf92abe84d7118a5. Resources: {'cores', 'ram', 'instances'} {{(pid=98843) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 13:57:55.382631 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-e5f3520f-b469-4a9e-95f5-b71fb72b13fe tempest-ServersTestJSON-1383685549 tempest-ServersTestJSON-1383685549-project] [instance: 5d8767d5-61ed-4c43-a195-b4de0f0d3fe8] Selected host: n-h1-791503-6; Selected node: n-h1-791503-6; Alternates: [('n-h2-791503-6', 'n-h2-791503-6')] {{(pid=98843) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 13:57:55.384254 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-e5f3520f-b469-4a9e-95f5-b71fb72b13fe tempest-ServersTestJSON-1383685549 tempest-ServersTestJSON-1383685549-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:57:55.385256 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-e5f3520f-b469-4a9e-95f5-b71fb72b13fe tempest-ServersTestJSON-1383685549 tempest-ServersTestJSON-1383685549-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:57:55.400227 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-e5f3520f-b469-4a9e-95f5-b71fb72b13fe tempest-ServersTestJSON-1383685549 tempest-ServersTestJSON-1383685549-project] [instance: 5d8767d5-61ed-4c43-a195-b4de0f0d3fe8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='64f6036b-99a9-40e4-8963-3cdf66964954',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98843) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 13:57:55.403893 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-e5f3520f-b469-4a9e-95f5-b71fb72b13fe tempest-ServersTestJSON-1383685549 tempest-ServersTestJSON-1383685549-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:57:55.405177 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-e5f3520f-b469-4a9e-95f5-b71fb72b13fe tempest-ServersTestJSON-1383685549 tempest-ServersTestJSON-1383685549-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:57:55.472745 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-e5f3520f-b469-4a9e-95f5-b71fb72b13fe tempest-ServersTestJSON-1383685549 tempest-ServersTestJSON-1383685549-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:57:55.473989 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-e5f3520f-b469-4a9e-95f5-b71fb72b13fe tempest-ServersTestJSON-1383685549 tempest-ServersTestJSON-1383685549-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:58:05.255367 n-d-791503-6 nova-conductor[98843]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 13:58:11.418668 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.manager [None req-cf98171c-7f47-4dde-96d6-858001500b77 tempest-DeleteServersTestJSON-444271794 tempest-DeleteServersTestJSON-444271794-project] Took 0.67 seconds to select destinations for 1 instance(s). {{(pid=98844) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 13:58:11.471371 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-cf98171c-7f47-4dde-96d6-858001500b77 tempest-DeleteServersTestJSON-444271794 tempest-DeleteServersTestJSON-444271794-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:58:11.471784 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-cf98171c-7f47-4dde-96d6-858001500b77 tempest-DeleteServersTestJSON-444271794 tempest-DeleteServersTestJSON-444271794-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:58:11.561619 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-cf98171c-7f47-4dde-96d6-858001500b77 tempest-DeleteServersTestJSON-444271794 tempest-DeleteServersTestJSON-444271794-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:58:11.563451 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-cf98171c-7f47-4dde-96d6-858001500b77 tempest-DeleteServersTestJSON-444271794 tempest-DeleteServersTestJSON-444271794-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:58:11.565885 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-cf98171c-7f47-4dde-96d6-858001500b77 tempest-DeleteServersTestJSON-444271794 tempest-DeleteServersTestJSON-444271794-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:58:11.567387 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-cf98171c-7f47-4dde-96d6-858001500b77 tempest-DeleteServersTestJSON-444271794 tempest-DeleteServersTestJSON-444271794-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:58:11.638139 n-d-791503-6 nova-conductor[98844]: DEBUG nova.quota [None req-cf98171c-7f47-4dde-96d6-858001500b77 tempest-DeleteServersTestJSON-444271794 tempest-DeleteServersTestJSON-444271794-project] Getting quotas for project effef6608bf4456ba198f8c88d5856db. Resources: {'cores', 'ram', 'instances'} {{(pid=98844) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 13:58:11.650706 n-d-791503-6 nova-conductor[98844]: DEBUG nova.quota [None req-cf98171c-7f47-4dde-96d6-858001500b77 tempest-DeleteServersTestJSON-444271794 tempest-DeleteServersTestJSON-444271794-project] Getting quotas for user 1cfa7b7d864e4213a312ba664434a79b and project effef6608bf4456ba198f8c88d5856db. Resources: {'cores', 'ram', 'instances'} {{(pid=98844) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 13:58:11.681796 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.manager [None req-cf98171c-7f47-4dde-96d6-858001500b77 tempest-DeleteServersTestJSON-444271794 tempest-DeleteServersTestJSON-444271794-project] [instance: 2c6083ca-a750-4cc7-a9bf-b892703ef1eb] Selected host: n-h2-791503-6; Selected node: n-h2-791503-6; Alternates: [('n-h1-791503-6', 'n-h1-791503-6')] {{(pid=98844) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 13:58:11.685812 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-cf98171c-7f47-4dde-96d6-858001500b77 tempest-DeleteServersTestJSON-444271794 tempest-DeleteServersTestJSON-444271794-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:58:11.689190 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-cf98171c-7f47-4dde-96d6-858001500b77 tempest-DeleteServersTestJSON-444271794 tempest-DeleteServersTestJSON-444271794-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:58:11.714827 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.manager [None req-cf98171c-7f47-4dde-96d6-858001500b77 tempest-DeleteServersTestJSON-444271794 tempest-DeleteServersTestJSON-444271794-project] [instance: 2c6083ca-a750-4cc7-a9bf-b892703ef1eb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='64f6036b-99a9-40e4-8963-3cdf66964954',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98844) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 13:58:11.720049 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-cf98171c-7f47-4dde-96d6-858001500b77 tempest-DeleteServersTestJSON-444271794 tempest-DeleteServersTestJSON-444271794-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:58:11.721377 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-cf98171c-7f47-4dde-96d6-858001500b77 tempest-DeleteServersTestJSON-444271794 tempest-DeleteServersTestJSON-444271794-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:58:11.830634 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-cf98171c-7f47-4dde-96d6-858001500b77 tempest-DeleteServersTestJSON-444271794 tempest-DeleteServersTestJSON-444271794-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:58:11.831344 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-cf98171c-7f47-4dde-96d6-858001500b77 tempest-DeleteServersTestJSON-444271794 tempest-DeleteServersTestJSON-444271794-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:58:39.679374 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-2f1ece0b-2d3e-4f1b-9d28-a0f72e911fab tempest-ServersTestJSON-1383685549 tempest-ServersTestJSON-1383685549-project] Took 0.76 seconds to select destinations for 1 instance(s). {{(pid=98843) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 13:58:39.718430 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-2f1ece0b-2d3e-4f1b-9d28-a0f72e911fab tempest-ServersTestJSON-1383685549 tempest-ServersTestJSON-1383685549-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:58:39.719106 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-2f1ece0b-2d3e-4f1b-9d28-a0f72e911fab tempest-ServersTestJSON-1383685549 tempest-ServersTestJSON-1383685549-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:58:39.800296 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-2f1ece0b-2d3e-4f1b-9d28-a0f72e911fab tempest-ServersTestJSON-1383685549 tempest-ServersTestJSON-1383685549-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:58:39.800903 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-2f1ece0b-2d3e-4f1b-9d28-a0f72e911fab tempest-ServersTestJSON-1383685549 tempest-ServersTestJSON-1383685549-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:58:39.801851 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-2f1ece0b-2d3e-4f1b-9d28-a0f72e911fab tempest-ServersTestJSON-1383685549 tempest-ServersTestJSON-1383685549-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:58:39.802335 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-2f1ece0b-2d3e-4f1b-9d28-a0f72e911fab tempest-ServersTestJSON-1383685549 tempest-ServersTestJSON-1383685549-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:58:39.855363 n-d-791503-6 nova-conductor[98843]: DEBUG nova.quota [None req-2f1ece0b-2d3e-4f1b-9d28-a0f72e911fab tempest-ServersTestJSON-1383685549 tempest-ServersTestJSON-1383685549-project] Getting quotas for project 4c8b6e6cc7d94c65bf92abe84d7118a5. Resources: {'cores', 'ram', 'instances'} {{(pid=98843) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 13:58:39.877228 n-d-791503-6 nova-conductor[98843]: DEBUG nova.quota [None req-2f1ece0b-2d3e-4f1b-9d28-a0f72e911fab tempest-ServersTestJSON-1383685549 tempest-ServersTestJSON-1383685549-project] Getting quotas for user 25da8d9566e7447a928740418a2ecb1f and project 4c8b6e6cc7d94c65bf92abe84d7118a5. Resources: {'cores', 'ram', 'instances'} {{(pid=98843) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 13:58:39.927312 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-2f1ece0b-2d3e-4f1b-9d28-a0f72e911fab tempest-ServersTestJSON-1383685549 tempest-ServersTestJSON-1383685549-project] [instance: ca0cc4c5-cbf9-4fcb-a3cd-7e1a0c9274b5] Selected host: n-h1-791503-6; Selected node: n-h1-791503-6; Alternates: [('n-h2-791503-6', 'n-h2-791503-6')] {{(pid=98843) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 13:58:39.935648 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-2f1ece0b-2d3e-4f1b-9d28-a0f72e911fab tempest-ServersTestJSON-1383685549 tempest-ServersTestJSON-1383685549-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:58:39.938286 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-2f1ece0b-2d3e-4f1b-9d28-a0f72e911fab tempest-ServersTestJSON-1383685549 tempest-ServersTestJSON-1383685549-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:58:39.956091 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-2f1ece0b-2d3e-4f1b-9d28-a0f72e911fab tempest-ServersTestJSON-1383685549 tempest-ServersTestJSON-1383685549-project] [instance: ca0cc4c5-cbf9-4fcb-a3cd-7e1a0c9274b5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='64f6036b-99a9-40e4-8963-3cdf66964954',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98843) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 13:58:39.959556 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-2f1ece0b-2d3e-4f1b-9d28-a0f72e911fab tempest-ServersTestJSON-1383685549 tempest-ServersTestJSON-1383685549-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:58:39.961001 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-2f1ece0b-2d3e-4f1b-9d28-a0f72e911fab tempest-ServersTestJSON-1383685549 tempest-ServersTestJSON-1383685549-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:58:40.098666 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-2f1ece0b-2d3e-4f1b-9d28-a0f72e911fab tempest-ServersTestJSON-1383685549 tempest-ServersTestJSON-1383685549-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:58:40.099147 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-2f1ece0b-2d3e-4f1b-9d28-a0f72e911fab tempest-ServersTestJSON-1383685549 tempest-ServersTestJSON-1383685549-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:59:20.558158 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.manager [None req-62039383-6f3e-475f-83ec-59b394561736 tempest-DeleteServersTestJSON-444271794 tempest-DeleteServersTestJSON-444271794-project] Took 0.60 seconds to select destinations for 1 instance(s). {{(pid=98844) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 13:59:20.643729 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-62039383-6f3e-475f-83ec-59b394561736 tempest-DeleteServersTestJSON-444271794 tempest-DeleteServersTestJSON-444271794-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:59:20.648613 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-62039383-6f3e-475f-83ec-59b394561736 tempest-DeleteServersTestJSON-444271794 tempest-DeleteServersTestJSON-444271794-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:59:20.799876 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-62039383-6f3e-475f-83ec-59b394561736 tempest-DeleteServersTestJSON-444271794 tempest-DeleteServersTestJSON-444271794-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:59:20.799876 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-62039383-6f3e-475f-83ec-59b394561736 tempest-DeleteServersTestJSON-444271794 tempest-DeleteServersTestJSON-444271794-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:59:20.800720 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-62039383-6f3e-475f-83ec-59b394561736 tempest-DeleteServersTestJSON-444271794 tempest-DeleteServersTestJSON-444271794-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:59:20.801422 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-62039383-6f3e-475f-83ec-59b394561736 tempest-DeleteServersTestJSON-444271794 tempest-DeleteServersTestJSON-444271794-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:59:20.848797 n-d-791503-6 nova-conductor[98844]: DEBUG nova.quota [None req-62039383-6f3e-475f-83ec-59b394561736 tempest-DeleteServersTestJSON-444271794 tempest-DeleteServersTestJSON-444271794-project] Getting quotas for project effef6608bf4456ba198f8c88d5856db. Resources: {'cores', 'ram', 'instances'} {{(pid=98844) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 13:59:20.863804 n-d-791503-6 nova-conductor[98844]: DEBUG nova.quota [None req-62039383-6f3e-475f-83ec-59b394561736 tempest-DeleteServersTestJSON-444271794 tempest-DeleteServersTestJSON-444271794-project] Getting quotas for user 1cfa7b7d864e4213a312ba664434a79b and project effef6608bf4456ba198f8c88d5856db. Resources: {'cores', 'ram', 'instances'} {{(pid=98844) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 13:59:20.943661 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.manager [None req-62039383-6f3e-475f-83ec-59b394561736 tempest-DeleteServersTestJSON-444271794 tempest-DeleteServersTestJSON-444271794-project] [instance: 75c61908-e0fe-4b1f-a22e-be824995a8f4] Selected host: n-h2-791503-6; Selected node: n-h2-791503-6; Alternates: [('n-h1-791503-6', 'n-h1-791503-6')] {{(pid=98844) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 13:59:20.948245 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-62039383-6f3e-475f-83ec-59b394561736 tempest-DeleteServersTestJSON-444271794 tempest-DeleteServersTestJSON-444271794-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:59:20.952019 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-62039383-6f3e-475f-83ec-59b394561736 tempest-DeleteServersTestJSON-444271794 tempest-DeleteServersTestJSON-444271794-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:59:21.000833 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.manager [None req-62039383-6f3e-475f-83ec-59b394561736 tempest-DeleteServersTestJSON-444271794 tempest-DeleteServersTestJSON-444271794-project] [instance: 75c61908-e0fe-4b1f-a22e-be824995a8f4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='64f6036b-99a9-40e4-8963-3cdf66964954',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98844) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 13:59:21.011853 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-62039383-6f3e-475f-83ec-59b394561736 tempest-DeleteServersTestJSON-444271794 tempest-DeleteServersTestJSON-444271794-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:59:21.012277 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-62039383-6f3e-475f-83ec-59b394561736 tempest-DeleteServersTestJSON-444271794 tempest-DeleteServersTestJSON-444271794-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:59:21.124220 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-62039383-6f3e-475f-83ec-59b394561736 tempest-DeleteServersTestJSON-444271794 tempest-DeleteServersTestJSON-444271794-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:59:21.124907 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-62039383-6f3e-475f-83ec-59b394561736 tempest-DeleteServersTestJSON-444271794 tempest-DeleteServersTestJSON-444271794-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:59:21.409327 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-5b3cf068-fb61-4061-b2b7-c13e379671e2 tempest-ServersTestJSON-1383685549 tempest-ServersTestJSON-1383685549-project] Took 0.53 seconds to select destinations for 1 instance(s). {{(pid=98843) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 13:59:21.442192 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-62039383-6f3e-475f-83ec-59b394561736 tempest-DeleteServersTestJSON-444271794 tempest-DeleteServersTestJSON-444271794-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:59:21.443754 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-62039383-6f3e-475f-83ec-59b394561736 tempest-DeleteServersTestJSON-444271794 tempest-DeleteServersTestJSON-444271794-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:59:21.468677 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-5b3cf068-fb61-4061-b2b7-c13e379671e2 tempest-ServersTestJSON-1383685549 tempest-ServersTestJSON-1383685549-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:59:21.469131 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-5b3cf068-fb61-4061-b2b7-c13e379671e2 tempest-ServersTestJSON-1383685549 tempest-ServersTestJSON-1383685549-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:59:21.590061 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-5b3cf068-fb61-4061-b2b7-c13e379671e2 tempest-ServersTestJSON-1383685549 tempest-ServersTestJSON-1383685549-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:59:21.590567 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-5b3cf068-fb61-4061-b2b7-c13e379671e2 tempest-ServersTestJSON-1383685549 tempest-ServersTestJSON-1383685549-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:59:21.591536 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-5b3cf068-fb61-4061-b2b7-c13e379671e2 tempest-ServersTestJSON-1383685549 tempest-ServersTestJSON-1383685549-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:59:21.592042 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-5b3cf068-fb61-4061-b2b7-c13e379671e2 tempest-ServersTestJSON-1383685549 tempest-ServersTestJSON-1383685549-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:59:21.640181 n-d-791503-6 nova-conductor[98843]: DEBUG nova.quota [None req-5b3cf068-fb61-4061-b2b7-c13e379671e2 tempest-ServersTestJSON-1383685549 tempest-ServersTestJSON-1383685549-project] Getting quotas for project 4c8b6e6cc7d94c65bf92abe84d7118a5. Resources: {'cores', 'ram', 'instances'} {{(pid=98843) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 13:59:21.648802 n-d-791503-6 nova-conductor[98843]: DEBUG nova.quota [None req-5b3cf068-fb61-4061-b2b7-c13e379671e2 tempest-ServersTestJSON-1383685549 tempest-ServersTestJSON-1383685549-project] Getting quotas for user 25da8d9566e7447a928740418a2ecb1f and project 4c8b6e6cc7d94c65bf92abe84d7118a5. Resources: {'cores', 'ram', 'instances'} {{(pid=98843) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 13:59:21.687767 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-5b3cf068-fb61-4061-b2b7-c13e379671e2 tempest-ServersTestJSON-1383685549 tempest-ServersTestJSON-1383685549-project] [instance: b9e24edf-1d27-4e58-b9b5-965f9eb90c2f] Selected host: n-h2-791503-6; Selected node: n-h2-791503-6; Alternates: [('n-h1-791503-6', 'n-h1-791503-6')] {{(pid=98843) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 13:59:21.688752 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-5b3cf068-fb61-4061-b2b7-c13e379671e2 tempest-ServersTestJSON-1383685549 tempest-ServersTestJSON-1383685549-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:59:21.689651 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-5b3cf068-fb61-4061-b2b7-c13e379671e2 tempest-ServersTestJSON-1383685549 tempest-ServersTestJSON-1383685549-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:59:21.711406 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-5b3cf068-fb61-4061-b2b7-c13e379671e2 tempest-ServersTestJSON-1383685549 tempest-ServersTestJSON-1383685549-project] [instance: b9e24edf-1d27-4e58-b9b5-965f9eb90c2f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='64f6036b-99a9-40e4-8963-3cdf66964954',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98843) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 13:59:21.712721 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-5b3cf068-fb61-4061-b2b7-c13e379671e2 tempest-ServersTestJSON-1383685549 tempest-ServersTestJSON-1383685549-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:59:21.713134 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-5b3cf068-fb61-4061-b2b7-c13e379671e2 tempest-ServersTestJSON-1383685549 tempest-ServersTestJSON-1383685549-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:59:21.780306 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-5b3cf068-fb61-4061-b2b7-c13e379671e2 tempest-ServersTestJSON-1383685549 tempest-ServersTestJSON-1383685549-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:59:21.781017 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-5b3cf068-fb61-4061-b2b7-c13e379671e2 tempest-ServersTestJSON-1383685549 tempest-ServersTestJSON-1383685549-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:59:29.619975 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.manager [None req-f0f5f87b-ef08-4596-977e-44fe65a28932 tempest-DeleteServersTestJSON-444271794 tempest-DeleteServersTestJSON-444271794-project] Took 0.51 seconds to select destinations for 1 instance(s). {{(pid=98844) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 13:59:29.669203 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-f0f5f87b-ef08-4596-977e-44fe65a28932 tempest-DeleteServersTestJSON-444271794 tempest-DeleteServersTestJSON-444271794-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:59:29.672693 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-f0f5f87b-ef08-4596-977e-44fe65a28932 tempest-DeleteServersTestJSON-444271794 tempest-DeleteServersTestJSON-444271794-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:59:29.779204 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-f0f5f87b-ef08-4596-977e-44fe65a28932 tempest-DeleteServersTestJSON-444271794 tempest-DeleteServersTestJSON-444271794-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:59:29.780562 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-f0f5f87b-ef08-4596-977e-44fe65a28932 tempest-DeleteServersTestJSON-444271794 tempest-DeleteServersTestJSON-444271794-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:59:29.782184 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-f0f5f87b-ef08-4596-977e-44fe65a28932 tempest-DeleteServersTestJSON-444271794 tempest-DeleteServersTestJSON-444271794-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:59:29.783405 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-f0f5f87b-ef08-4596-977e-44fe65a28932 tempest-DeleteServersTestJSON-444271794 tempest-DeleteServersTestJSON-444271794-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:59:29.830008 n-d-791503-6 nova-conductor[98844]: DEBUG nova.quota [None req-f0f5f87b-ef08-4596-977e-44fe65a28932 tempest-DeleteServersTestJSON-444271794 tempest-DeleteServersTestJSON-444271794-project] Getting quotas for project effef6608bf4456ba198f8c88d5856db. Resources: {'cores', 'ram', 'instances'} {{(pid=98844) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 13:59:29.845597 n-d-791503-6 nova-conductor[98844]: DEBUG nova.quota [None req-f0f5f87b-ef08-4596-977e-44fe65a28932 tempest-DeleteServersTestJSON-444271794 tempest-DeleteServersTestJSON-444271794-project] Getting quotas for user 1cfa7b7d864e4213a312ba664434a79b and project effef6608bf4456ba198f8c88d5856db. Resources: {'cores', 'ram', 'instances'} {{(pid=98844) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 13:59:29.891248 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.manager [None req-f0f5f87b-ef08-4596-977e-44fe65a28932 tempest-DeleteServersTestJSON-444271794 tempest-DeleteServersTestJSON-444271794-project] [instance: 87c20438-8f73-4a15-8250-e31aa444bee9] Selected host: n-h1-791503-6; Selected node: n-h1-791503-6; Alternates: [('n-h2-791503-6', 'n-h2-791503-6')] {{(pid=98844) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 13:59:29.900412 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-f0f5f87b-ef08-4596-977e-44fe65a28932 tempest-DeleteServersTestJSON-444271794 tempest-DeleteServersTestJSON-444271794-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:59:29.901645 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-f0f5f87b-ef08-4596-977e-44fe65a28932 tempest-DeleteServersTestJSON-444271794 tempest-DeleteServersTestJSON-444271794-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:59:29.927010 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.manager [None req-f0f5f87b-ef08-4596-977e-44fe65a28932 tempest-DeleteServersTestJSON-444271794 tempest-DeleteServersTestJSON-444271794-project] [instance: 87c20438-8f73-4a15-8250-e31aa444bee9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='64f6036b-99a9-40e4-8963-3cdf66964954',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98844) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 13:59:29.935195 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-f0f5f87b-ef08-4596-977e-44fe65a28932 tempest-DeleteServersTestJSON-444271794 tempest-DeleteServersTestJSON-444271794-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:59:29.935195 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-f0f5f87b-ef08-4596-977e-44fe65a28932 tempest-DeleteServersTestJSON-444271794 tempest-DeleteServersTestJSON-444271794-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:59:30.143240 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-f0f5f87b-ef08-4596-977e-44fe65a28932 tempest-DeleteServersTestJSON-444271794 tempest-DeleteServersTestJSON-444271794-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:59:30.147096 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-f0f5f87b-ef08-4596-977e-44fe65a28932 tempest-DeleteServersTestJSON-444271794 tempest-DeleteServersTestJSON-444271794-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:59:32.466050 n-d-791503-6 nova-conductor[98844]: ERROR oslo.messaging._drivers.impl_rabbit [-] [cbd7c90c-b59a-4f8b-992f-d04ba5ad6f9c] AMQP server on 10.222.0.68:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 28 13:59:33.491696 n-d-791503-6 nova-conductor[98844]: INFO oslo.messaging._drivers.impl_rabbit [-] [cbd7c90c-b59a-4f8b-992f-d04ba5ad6f9c] Reconnected to AMQP server on 10.222.0.68:5672 via [amqp] client with port 47510. May 28 13:59:57.213847 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-35f0bf73-22cb-4fc1-833b-c42aba9cfa77 tempest-ServersTestJSON-1383685549 tempest-ServersTestJSON-1383685549-project] Took 0.58 seconds to select destinations for 1 instance(s). {{(pid=98843) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 13:59:57.260602 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-35f0bf73-22cb-4fc1-833b-c42aba9cfa77 tempest-ServersTestJSON-1383685549 tempest-ServersTestJSON-1383685549-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:59:57.261006 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-35f0bf73-22cb-4fc1-833b-c42aba9cfa77 tempest-ServersTestJSON-1383685549 tempest-ServersTestJSON-1383685549-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:59:57.338030 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-35f0bf73-22cb-4fc1-833b-c42aba9cfa77 tempest-ServersTestJSON-1383685549 tempest-ServersTestJSON-1383685549-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:59:57.338440 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-35f0bf73-22cb-4fc1-833b-c42aba9cfa77 tempest-ServersTestJSON-1383685549 tempest-ServersTestJSON-1383685549-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:59:57.341199 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-35f0bf73-22cb-4fc1-833b-c42aba9cfa77 tempest-ServersTestJSON-1383685549 tempest-ServersTestJSON-1383685549-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:59:57.342536 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-35f0bf73-22cb-4fc1-833b-c42aba9cfa77 tempest-ServersTestJSON-1383685549 tempest-ServersTestJSON-1383685549-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:59:57.383201 n-d-791503-6 nova-conductor[98843]: DEBUG nova.quota [None req-35f0bf73-22cb-4fc1-833b-c42aba9cfa77 tempest-ServersTestJSON-1383685549 tempest-ServersTestJSON-1383685549-project] Getting quotas for project 4c8b6e6cc7d94c65bf92abe84d7118a5. Resources: {'cores', 'ram', 'instances'} {{(pid=98843) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 13:59:57.397997 n-d-791503-6 nova-conductor[98843]: DEBUG nova.quota [None req-35f0bf73-22cb-4fc1-833b-c42aba9cfa77 tempest-ServersTestJSON-1383685549 tempest-ServersTestJSON-1383685549-project] Getting quotas for user 25da8d9566e7447a928740418a2ecb1f and project 4c8b6e6cc7d94c65bf92abe84d7118a5. Resources: {'cores', 'ram', 'instances'} {{(pid=98843) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 13:59:57.414536 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-35f0bf73-22cb-4fc1-833b-c42aba9cfa77 tempest-ServersTestJSON-1383685549 tempest-ServersTestJSON-1383685549-project] [instance: 6e988a01-d27f-429f-bd52-27c8462c37aa] Selected host: n-h2-791503-6; Selected node: n-h2-791503-6; Alternates: [('n-h1-791503-6', 'n-h1-791503-6')] {{(pid=98843) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 13:59:57.415539 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-35f0bf73-22cb-4fc1-833b-c42aba9cfa77 tempest-ServersTestJSON-1383685549 tempest-ServersTestJSON-1383685549-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:59:57.415936 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-35f0bf73-22cb-4fc1-833b-c42aba9cfa77 tempest-ServersTestJSON-1383685549 tempest-ServersTestJSON-1383685549-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:59:57.425480 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-35f0bf73-22cb-4fc1-833b-c42aba9cfa77 tempest-ServersTestJSON-1383685549 tempest-ServersTestJSON-1383685549-project] [instance: 6e988a01-d27f-429f-bd52-27c8462c37aa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='64f6036b-99a9-40e4-8963-3cdf66964954',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98843) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 13:59:57.428954 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-35f0bf73-22cb-4fc1-833b-c42aba9cfa77 tempest-ServersTestJSON-1383685549 tempest-ServersTestJSON-1383685549-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:59:57.429410 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-35f0bf73-22cb-4fc1-833b-c42aba9cfa77 tempest-ServersTestJSON-1383685549 tempest-ServersTestJSON-1383685549-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 13:59:57.502514 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-35f0bf73-22cb-4fc1-833b-c42aba9cfa77 tempest-ServersTestJSON-1383685549 tempest-ServersTestJSON-1383685549-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 13:59:57.503781 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-35f0bf73-22cb-4fc1-833b-c42aba9cfa77 tempest-ServersTestJSON-1383685549 tempest-ServersTestJSON-1383685549-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:00:15.617785 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.manager [None req-6f76da7f-fb19-447c-90ed-f0b77df6586d tempest-DeleteServersTestJSON-444271794 tempest-DeleteServersTestJSON-444271794-project] Took 0.50 seconds to select destinations for 1 instance(s). {{(pid=98844) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 14:00:15.691024 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-6f76da7f-fb19-447c-90ed-f0b77df6586d tempest-DeleteServersTestJSON-444271794 tempest-DeleteServersTestJSON-444271794-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:00:15.692047 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-6f76da7f-fb19-447c-90ed-f0b77df6586d tempest-DeleteServersTestJSON-444271794 tempest-DeleteServersTestJSON-444271794-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:00:15.816195 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-6f76da7f-fb19-447c-90ed-f0b77df6586d tempest-DeleteServersTestJSON-444271794 tempest-DeleteServersTestJSON-444271794-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:00:15.817047 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-6f76da7f-fb19-447c-90ed-f0b77df6586d tempest-DeleteServersTestJSON-444271794 tempest-DeleteServersTestJSON-444271794-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:00:15.818477 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-6f76da7f-fb19-447c-90ed-f0b77df6586d tempest-DeleteServersTestJSON-444271794 tempest-DeleteServersTestJSON-444271794-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:00:15.819637 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-6f76da7f-fb19-447c-90ed-f0b77df6586d tempest-DeleteServersTestJSON-444271794 tempest-DeleteServersTestJSON-444271794-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:00:15.865702 n-d-791503-6 nova-conductor[98844]: DEBUG nova.quota [None req-6f76da7f-fb19-447c-90ed-f0b77df6586d tempest-DeleteServersTestJSON-444271794 tempest-DeleteServersTestJSON-444271794-project] Getting quotas for project effef6608bf4456ba198f8c88d5856db. Resources: {'cores', 'ram', 'instances'} {{(pid=98844) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 14:00:15.881468 n-d-791503-6 nova-conductor[98844]: DEBUG nova.quota [None req-6f76da7f-fb19-447c-90ed-f0b77df6586d tempest-DeleteServersTestJSON-444271794 tempest-DeleteServersTestJSON-444271794-project] Getting quotas for user 1cfa7b7d864e4213a312ba664434a79b and project effef6608bf4456ba198f8c88d5856db. Resources: {'cores', 'ram', 'instances'} {{(pid=98844) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 14:00:15.910336 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.manager [None req-6f76da7f-fb19-447c-90ed-f0b77df6586d tempest-DeleteServersTestJSON-444271794 tempest-DeleteServersTestJSON-444271794-project] [instance: 39fed3d9-e7d9-4585-a3b8-c23203d5f241] Selected host: n-h1-791503-6; Selected node: n-h1-791503-6; Alternates: [('n-h2-791503-6', 'n-h2-791503-6')] {{(pid=98844) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 14:00:15.915546 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-6f76da7f-fb19-447c-90ed-f0b77df6586d tempest-DeleteServersTestJSON-444271794 tempest-DeleteServersTestJSON-444271794-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:00:15.916880 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-6f76da7f-fb19-447c-90ed-f0b77df6586d tempest-DeleteServersTestJSON-444271794 tempest-DeleteServersTestJSON-444271794-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:00:15.944933 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.manager [None req-6f76da7f-fb19-447c-90ed-f0b77df6586d tempest-DeleteServersTestJSON-444271794 tempest-DeleteServersTestJSON-444271794-project] [instance: 39fed3d9-e7d9-4585-a3b8-c23203d5f241] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='64f6036b-99a9-40e4-8963-3cdf66964954',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98844) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 14:00:15.947040 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-6f76da7f-fb19-447c-90ed-f0b77df6586d tempest-DeleteServersTestJSON-444271794 tempest-DeleteServersTestJSON-444271794-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:00:15.947777 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-6f76da7f-fb19-447c-90ed-f0b77df6586d tempest-DeleteServersTestJSON-444271794 tempest-DeleteServersTestJSON-444271794-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:00:16.016267 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-6f76da7f-fb19-447c-90ed-f0b77df6586d tempest-DeleteServersTestJSON-444271794 tempest-DeleteServersTestJSON-444271794-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:00:16.017150 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-6f76da7f-fb19-447c-90ed-f0b77df6586d tempest-DeleteServersTestJSON-444271794 tempest-DeleteServersTestJSON-444271794-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:00:24.075287 n-d-791503-6 nova-conductor[98843]: ERROR oslo.messaging._drivers.impl_rabbit [-] [fb67aa64-250d-4c34-b696-14a5dd0b49b6] AMQP server on 10.222.0.68:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection May 28 14:00:25.125007 n-d-791503-6 nova-conductor[98843]: INFO oslo.messaging._drivers.impl_rabbit [-] [fb67aa64-250d-4c34-b696-14a5dd0b49b6] Reconnected to AMQP server on 10.222.0.68:5672 via [amqp] client with port 48278. May 28 14:00:49.382180 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-d70bb485-8194-4f2a-bdfc-50d1b9ce0a74 tempest-ServersTestJSON-1383685549 tempest-ServersTestJSON-1383685549-project] Took 0.67 seconds to select destinations for 1 instance(s). {{(pid=98843) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 14:00:49.414952 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-d70bb485-8194-4f2a-bdfc-50d1b9ce0a74 tempest-ServersTestJSON-1383685549 tempest-ServersTestJSON-1383685549-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:00:49.416087 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-d70bb485-8194-4f2a-bdfc-50d1b9ce0a74 tempest-ServersTestJSON-1383685549 tempest-ServersTestJSON-1383685549-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:00:49.482656 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-d70bb485-8194-4f2a-bdfc-50d1b9ce0a74 tempest-ServersTestJSON-1383685549 tempest-ServersTestJSON-1383685549-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:00:49.483624 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-d70bb485-8194-4f2a-bdfc-50d1b9ce0a74 tempest-ServersTestJSON-1383685549 tempest-ServersTestJSON-1383685549-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:00:49.485501 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-d70bb485-8194-4f2a-bdfc-50d1b9ce0a74 tempest-ServersTestJSON-1383685549 tempest-ServersTestJSON-1383685549-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:00:49.486356 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-d70bb485-8194-4f2a-bdfc-50d1b9ce0a74 tempest-ServersTestJSON-1383685549 tempest-ServersTestJSON-1383685549-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:00:49.518458 n-d-791503-6 nova-conductor[98843]: DEBUG nova.quota [None req-d70bb485-8194-4f2a-bdfc-50d1b9ce0a74 tempest-ServersTestJSON-1383685549 tempest-ServersTestJSON-1383685549-project] Getting quotas for project 4c8b6e6cc7d94c65bf92abe84d7118a5. Resources: {'cores', 'ram', 'instances'} {{(pid=98843) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 14:00:49.548451 n-d-791503-6 nova-conductor[98843]: DEBUG nova.quota [None req-d70bb485-8194-4f2a-bdfc-50d1b9ce0a74 tempest-ServersTestJSON-1383685549 tempest-ServersTestJSON-1383685549-project] Getting quotas for user 25da8d9566e7447a928740418a2ecb1f and project 4c8b6e6cc7d94c65bf92abe84d7118a5. Resources: {'cores', 'ram', 'instances'} {{(pid=98843) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 14:00:49.580991 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-d70bb485-8194-4f2a-bdfc-50d1b9ce0a74 tempest-ServersTestJSON-1383685549 tempest-ServersTestJSON-1383685549-project] [instance: 64fe618e-39a1-4984-a420-4bbdc8e1208a] Selected host: n-h2-791503-6; Selected node: n-h2-791503-6; Alternates: [('n-h1-791503-6', 'n-h1-791503-6')] {{(pid=98843) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 14:00:49.583467 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-d70bb485-8194-4f2a-bdfc-50d1b9ce0a74 tempest-ServersTestJSON-1383685549 tempest-ServersTestJSON-1383685549-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:00:49.586228 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-d70bb485-8194-4f2a-bdfc-50d1b9ce0a74 tempest-ServersTestJSON-1383685549 tempest-ServersTestJSON-1383685549-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:00:49.612581 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-d70bb485-8194-4f2a-bdfc-50d1b9ce0a74 tempest-ServersTestJSON-1383685549 tempest-ServersTestJSON-1383685549-project] [instance: 64fe618e-39a1-4984-a420-4bbdc8e1208a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='64f6036b-99a9-40e4-8963-3cdf66964954',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98843) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 14:00:49.615156 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-d70bb485-8194-4f2a-bdfc-50d1b9ce0a74 tempest-ServersTestJSON-1383685549 tempest-ServersTestJSON-1383685549-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:00:49.616054 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-d70bb485-8194-4f2a-bdfc-50d1b9ce0a74 tempest-ServersTestJSON-1383685549 tempest-ServersTestJSON-1383685549-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:00:49.705255 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-d70bb485-8194-4f2a-bdfc-50d1b9ce0a74 tempest-ServersTestJSON-1383685549 tempest-ServersTestJSON-1383685549-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:00:49.708533 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-d70bb485-8194-4f2a-bdfc-50d1b9ce0a74 tempest-ServersTestJSON-1383685549 tempest-ServersTestJSON-1383685549-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:01:25.306894 n-d-791503-6 nova-conductor[98843]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 14:01:26.875302 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.manager [None req-c021486a-f8de-421b-b6cb-2e1899f93d12 tempest-ServersTestJSON-1383685549 tempest-ServersTestJSON-1383685549-project] Took 0.69 seconds to select destinations for 1 instance(s). {{(pid=98844) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 14:01:26.954617 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-c021486a-f8de-421b-b6cb-2e1899f93d12 tempest-ServersTestJSON-1383685549 tempest-ServersTestJSON-1383685549-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:01:26.956630 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-c021486a-f8de-421b-b6cb-2e1899f93d12 tempest-ServersTestJSON-1383685549 tempest-ServersTestJSON-1383685549-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:01:27.059868 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-c021486a-f8de-421b-b6cb-2e1899f93d12 tempest-ServersTestJSON-1383685549 tempest-ServersTestJSON-1383685549-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:01:27.061739 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-c021486a-f8de-421b-b6cb-2e1899f93d12 tempest-ServersTestJSON-1383685549 tempest-ServersTestJSON-1383685549-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:01:27.063180 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-c021486a-f8de-421b-b6cb-2e1899f93d12 tempest-ServersTestJSON-1383685549 tempest-ServersTestJSON-1383685549-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:01:27.063790 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-c021486a-f8de-421b-b6cb-2e1899f93d12 tempest-ServersTestJSON-1383685549 tempest-ServersTestJSON-1383685549-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:01:27.087838 n-d-791503-6 nova-conductor[98844]: DEBUG nova.quota [None req-c021486a-f8de-421b-b6cb-2e1899f93d12 tempest-ServersTestJSON-1383685549 tempest-ServersTestJSON-1383685549-project] Getting quotas for project 4c8b6e6cc7d94c65bf92abe84d7118a5. Resources: {'cores', 'ram', 'instances'} {{(pid=98844) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 14:01:27.130333 n-d-791503-6 nova-conductor[98844]: DEBUG nova.quota [None req-c021486a-f8de-421b-b6cb-2e1899f93d12 tempest-ServersTestJSON-1383685549 tempest-ServersTestJSON-1383685549-project] Getting quotas for user 25da8d9566e7447a928740418a2ecb1f and project 4c8b6e6cc7d94c65bf92abe84d7118a5. Resources: {'cores', 'ram', 'instances'} {{(pid=98844) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 14:01:27.192538 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.manager [None req-c021486a-f8de-421b-b6cb-2e1899f93d12 tempest-ServersTestJSON-1383685549 tempest-ServersTestJSON-1383685549-project] [instance: 93700b12-0740-4817-9620-f9f230f1bd03] Selected host: n-h2-791503-6; Selected node: n-h2-791503-6; Alternates: [('n-h1-791503-6', 'n-h1-791503-6')] {{(pid=98844) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 14:01:27.196102 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-c021486a-f8de-421b-b6cb-2e1899f93d12 tempest-ServersTestJSON-1383685549 tempest-ServersTestJSON-1383685549-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:01:27.198663 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-c021486a-f8de-421b-b6cb-2e1899f93d12 tempest-ServersTestJSON-1383685549 tempest-ServersTestJSON-1383685549-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:01:27.221052 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.manager [None req-c021486a-f8de-421b-b6cb-2e1899f93d12 tempest-ServersTestJSON-1383685549 tempest-ServersTestJSON-1383685549-project] [instance: 93700b12-0740-4817-9620-f9f230f1bd03] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='64f6036b-99a9-40e4-8963-3cdf66964954',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98844) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 14:01:27.222796 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-c021486a-f8de-421b-b6cb-2e1899f93d12 tempest-ServersTestJSON-1383685549 tempest-ServersTestJSON-1383685549-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:01:27.223683 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-c021486a-f8de-421b-b6cb-2e1899f93d12 tempest-ServersTestJSON-1383685549 tempest-ServersTestJSON-1383685549-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:01:27.375773 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-c021486a-f8de-421b-b6cb-2e1899f93d12 tempest-ServersTestJSON-1383685549 tempest-ServersTestJSON-1383685549-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:01:27.376450 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-c021486a-f8de-421b-b6cb-2e1899f93d12 tempest-ServersTestJSON-1383685549 tempest-ServersTestJSON-1383685549-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:01:55.911788 n-d-791503-6 nova-conductor[98844]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 14:02:07.601002 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-c12083ce-2123-4fdf-8282-800e9625a7af tempest-AttachVolumeTestJSON-597064669 tempest-AttachVolumeTestJSON-597064669-project] Took 1.11 seconds to select destinations for 1 instance(s). {{(pid=98843) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 14:02:07.671713 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-c12083ce-2123-4fdf-8282-800e9625a7af tempest-AttachVolumeTestJSON-597064669 tempest-AttachVolumeTestJSON-597064669-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:02:07.672565 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-c12083ce-2123-4fdf-8282-800e9625a7af tempest-AttachVolumeTestJSON-597064669 tempest-AttachVolumeTestJSON-597064669-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:02:07.747396 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-c12083ce-2123-4fdf-8282-800e9625a7af tempest-AttachVolumeTestJSON-597064669 tempest-AttachVolumeTestJSON-597064669-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:02:07.750567 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-c12083ce-2123-4fdf-8282-800e9625a7af tempest-AttachVolumeTestJSON-597064669 tempest-AttachVolumeTestJSON-597064669-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:02:07.751632 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-c12083ce-2123-4fdf-8282-800e9625a7af tempest-AttachVolumeTestJSON-597064669 tempest-AttachVolumeTestJSON-597064669-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:02:07.752316 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-c12083ce-2123-4fdf-8282-800e9625a7af tempest-AttachVolumeTestJSON-597064669 tempest-AttachVolumeTestJSON-597064669-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:02:07.778212 n-d-791503-6 nova-conductor[98843]: DEBUG nova.quota [None req-c12083ce-2123-4fdf-8282-800e9625a7af tempest-AttachVolumeTestJSON-597064669 tempest-AttachVolumeTestJSON-597064669-project] Getting quotas for project c48213e39e0b467480207de2e5ad171e. Resources: {'cores', 'ram', 'instances'} {{(pid=98843) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 14:02:07.787911 n-d-791503-6 nova-conductor[98843]: DEBUG nova.quota [None req-c12083ce-2123-4fdf-8282-800e9625a7af tempest-AttachVolumeTestJSON-597064669 tempest-AttachVolumeTestJSON-597064669-project] Getting quotas for user 46bb534bc526423c80a6e85b97cf3155 and project c48213e39e0b467480207de2e5ad171e. Resources: {'cores', 'ram', 'instances'} {{(pid=98843) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 14:02:07.814710 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-c12083ce-2123-4fdf-8282-800e9625a7af tempest-AttachVolumeTestJSON-597064669 tempest-AttachVolumeTestJSON-597064669-project] [instance: f612e899-f931-45a1-a4f0-8085bb71c165] Selected host: n-h1-791503-6; Selected node: n-h1-791503-6; Alternates: [('n-h2-791503-6', 'n-h2-791503-6')] {{(pid=98843) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 14:02:07.817444 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-c12083ce-2123-4fdf-8282-800e9625a7af tempest-AttachVolumeTestJSON-597064669 tempest-AttachVolumeTestJSON-597064669-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:02:07.818339 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-c12083ce-2123-4fdf-8282-800e9625a7af tempest-AttachVolumeTestJSON-597064669 tempest-AttachVolumeTestJSON-597064669-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:02:07.858635 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-c12083ce-2123-4fdf-8282-800e9625a7af tempest-AttachVolumeTestJSON-597064669 tempest-AttachVolumeTestJSON-597064669-project] [instance: f612e899-f931-45a1-a4f0-8085bb71c165] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='64f6036b-99a9-40e4-8963-3cdf66964954',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98843) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 14:02:07.860909 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-c12083ce-2123-4fdf-8282-800e9625a7af tempest-AttachVolumeTestJSON-597064669 tempest-AttachVolumeTestJSON-597064669-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:02:07.862102 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-c12083ce-2123-4fdf-8282-800e9625a7af tempest-AttachVolumeTestJSON-597064669 tempest-AttachVolumeTestJSON-597064669-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:02:07.934767 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-c12083ce-2123-4fdf-8282-800e9625a7af tempest-AttachVolumeTestJSON-597064669 tempest-AttachVolumeTestJSON-597064669-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:02:07.935622 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-c12083ce-2123-4fdf-8282-800e9625a7af tempest-AttachVolumeTestJSON-597064669 tempest-AttachVolumeTestJSON-597064669-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:02:15.837032 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.manager [None req-23487650-e4e9-4613-93eb-c470e791c1a1 tempest-DeleteServersTestJSON-444271794 tempest-DeleteServersTestJSON-444271794-project] Took 0.47 seconds to select destinations for 1 instance(s). {{(pid=98844) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 14:02:15.903112 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-23487650-e4e9-4613-93eb-c470e791c1a1 tempest-DeleteServersTestJSON-444271794 tempest-DeleteServersTestJSON-444271794-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:02:15.908037 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-23487650-e4e9-4613-93eb-c470e791c1a1 tempest-DeleteServersTestJSON-444271794 tempest-DeleteServersTestJSON-444271794-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:02:16.010424 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-23487650-e4e9-4613-93eb-c470e791c1a1 tempest-DeleteServersTestJSON-444271794 tempest-DeleteServersTestJSON-444271794-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:02:16.011353 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-23487650-e4e9-4613-93eb-c470e791c1a1 tempest-DeleteServersTestJSON-444271794 tempest-DeleteServersTestJSON-444271794-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:02:16.012308 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-23487650-e4e9-4613-93eb-c470e791c1a1 tempest-DeleteServersTestJSON-444271794 tempest-DeleteServersTestJSON-444271794-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:02:16.012898 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-23487650-e4e9-4613-93eb-c470e791c1a1 tempest-DeleteServersTestJSON-444271794 tempest-DeleteServersTestJSON-444271794-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:02:16.040379 n-d-791503-6 nova-conductor[98844]: DEBUG nova.quota [None req-23487650-e4e9-4613-93eb-c470e791c1a1 tempest-DeleteServersTestJSON-444271794 tempest-DeleteServersTestJSON-444271794-project] Getting quotas for project effef6608bf4456ba198f8c88d5856db. Resources: {'cores', 'ram', 'instances'} {{(pid=98844) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 14:02:16.046466 n-d-791503-6 nova-conductor[98844]: DEBUG nova.quota [None req-23487650-e4e9-4613-93eb-c470e791c1a1 tempest-DeleteServersTestJSON-444271794 tempest-DeleteServersTestJSON-444271794-project] Getting quotas for user 1cfa7b7d864e4213a312ba664434a79b and project effef6608bf4456ba198f8c88d5856db. Resources: {'cores', 'ram', 'instances'} {{(pid=98844) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 14:02:16.067564 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.manager [None req-23487650-e4e9-4613-93eb-c470e791c1a1 tempest-DeleteServersTestJSON-444271794 tempest-DeleteServersTestJSON-444271794-project] [instance: 59af2da5-74f0-42d9-bfce-0c424781ccbe] Selected host: n-h2-791503-6; Selected node: n-h2-791503-6; Alternates: [('n-h1-791503-6', 'n-h1-791503-6')] {{(pid=98844) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 14:02:16.069090 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-23487650-e4e9-4613-93eb-c470e791c1a1 tempest-DeleteServersTestJSON-444271794 tempest-DeleteServersTestJSON-444271794-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:02:16.069706 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-23487650-e4e9-4613-93eb-c470e791c1a1 tempest-DeleteServersTestJSON-444271794 tempest-DeleteServersTestJSON-444271794-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:02:16.079356 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.manager [None req-23487650-e4e9-4613-93eb-c470e791c1a1 tempest-DeleteServersTestJSON-444271794 tempest-DeleteServersTestJSON-444271794-project] [instance: 59af2da5-74f0-42d9-bfce-0c424781ccbe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='64f6036b-99a9-40e4-8963-3cdf66964954',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98844) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 14:02:16.082308 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-23487650-e4e9-4613-93eb-c470e791c1a1 tempest-DeleteServersTestJSON-444271794 tempest-DeleteServersTestJSON-444271794-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:02:16.083157 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-23487650-e4e9-4613-93eb-c470e791c1a1 tempest-DeleteServersTestJSON-444271794 tempest-DeleteServersTestJSON-444271794-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:02:16.137901 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-23487650-e4e9-4613-93eb-c470e791c1a1 tempest-DeleteServersTestJSON-444271794 tempest-DeleteServersTestJSON-444271794-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:02:16.138712 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-23487650-e4e9-4613-93eb-c470e791c1a1 tempest-DeleteServersTestJSON-444271794 tempest-DeleteServersTestJSON-444271794-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:02:33.488063 n-d-791503-6 nova-conductor[98844]: ERROR oslo.messaging._drivers.impl_rabbit [-] [cbd7c90c-b59a-4f8b-992f-d04ba5ad6f9c] AMQP server on 10.222.0.68:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection May 28 14:02:34.545308 n-d-791503-6 nova-conductor[98844]: INFO oslo.messaging._drivers.impl_rabbit [-] [cbd7c90c-b59a-4f8b-992f-d04ba5ad6f9c] Reconnected to AMQP server on 10.222.0.68:5672 via [amqp] client with port 50704. May 28 14:03:25.116341 n-d-791503-6 nova-conductor[98843]: ERROR oslo.messaging._drivers.impl_rabbit [-] [fb67aa64-250d-4c34-b696-14a5dd0b49b6] AMQP server on 10.222.0.68:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 28 14:03:26.159573 n-d-791503-6 nova-conductor[98843]: INFO oslo.messaging._drivers.impl_rabbit [-] [fb67aa64-250d-4c34-b696-14a5dd0b49b6] Reconnected to AMQP server on 10.222.0.68:5672 via [amqp] client with port 51950. May 28 14:03:37.247763 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-e6abcb8b-378e-46f7-b87a-a39548c44c0b tempest-DeleteServersTestJSON-444271794 tempest-DeleteServersTestJSON-444271794-project] Took 0.85 seconds to select destinations for 1 instance(s). {{(pid=98843) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 14:03:37.307693 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-e6abcb8b-378e-46f7-b87a-a39548c44c0b tempest-DeleteServersTestJSON-444271794 tempest-DeleteServersTestJSON-444271794-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:03:37.308006 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-e6abcb8b-378e-46f7-b87a-a39548c44c0b tempest-DeleteServersTestJSON-444271794 tempest-DeleteServersTestJSON-444271794-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:03:37.444329 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-e6abcb8b-378e-46f7-b87a-a39548c44c0b tempest-DeleteServersTestJSON-444271794 tempest-DeleteServersTestJSON-444271794-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:03:37.445854 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-e6abcb8b-378e-46f7-b87a-a39548c44c0b tempest-DeleteServersTestJSON-444271794 tempest-DeleteServersTestJSON-444271794-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:03:37.447477 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-e6abcb8b-378e-46f7-b87a-a39548c44c0b tempest-DeleteServersTestJSON-444271794 tempest-DeleteServersTestJSON-444271794-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:03:37.448637 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-e6abcb8b-378e-46f7-b87a-a39548c44c0b tempest-DeleteServersTestJSON-444271794 tempest-DeleteServersTestJSON-444271794-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:03:37.483002 n-d-791503-6 nova-conductor[98843]: DEBUG nova.quota [None req-e6abcb8b-378e-46f7-b87a-a39548c44c0b tempest-DeleteServersTestJSON-444271794 tempest-DeleteServersTestJSON-444271794-project] Getting quotas for project effef6608bf4456ba198f8c88d5856db. Resources: {'cores', 'ram', 'instances'} {{(pid=98843) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 14:03:37.493613 n-d-791503-6 nova-conductor[98843]: DEBUG nova.quota [None req-e6abcb8b-378e-46f7-b87a-a39548c44c0b tempest-DeleteServersTestJSON-444271794 tempest-DeleteServersTestJSON-444271794-project] Getting quotas for user 1cfa7b7d864e4213a312ba664434a79b and project effef6608bf4456ba198f8c88d5856db. Resources: {'cores', 'ram', 'instances'} {{(pid=98843) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 14:03:37.517790 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-e6abcb8b-378e-46f7-b87a-a39548c44c0b tempest-DeleteServersTestJSON-444271794 tempest-DeleteServersTestJSON-444271794-project] [instance: 01d00c67-ac41-4084-baeb-d0d9c5f6e6ea] Selected host: n-h2-791503-6; Selected node: n-h2-791503-6; Alternates: [('n-h1-791503-6', 'n-h1-791503-6')] {{(pid=98843) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 14:03:37.519978 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-e6abcb8b-378e-46f7-b87a-a39548c44c0b tempest-DeleteServersTestJSON-444271794 tempest-DeleteServersTestJSON-444271794-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:03:37.520939 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-e6abcb8b-378e-46f7-b87a-a39548c44c0b tempest-DeleteServersTestJSON-444271794 tempest-DeleteServersTestJSON-444271794-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:03:37.543151 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-e6abcb8b-378e-46f7-b87a-a39548c44c0b tempest-DeleteServersTestJSON-444271794 tempest-DeleteServersTestJSON-444271794-project] [instance: 01d00c67-ac41-4084-baeb-d0d9c5f6e6ea] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='64f6036b-99a9-40e4-8963-3cdf66964954',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98843) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 14:03:37.545678 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-e6abcb8b-378e-46f7-b87a-a39548c44c0b tempest-DeleteServersTestJSON-444271794 tempest-DeleteServersTestJSON-444271794-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:03:37.546381 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-e6abcb8b-378e-46f7-b87a-a39548c44c0b tempest-DeleteServersTestJSON-444271794 tempest-DeleteServersTestJSON-444271794-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:03:37.631821 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-e6abcb8b-378e-46f7-b87a-a39548c44c0b tempest-DeleteServersTestJSON-444271794 tempest-DeleteServersTestJSON-444271794-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:03:37.632533 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-e6abcb8b-378e-46f7-b87a-a39548c44c0b tempest-DeleteServersTestJSON-444271794 tempest-DeleteServersTestJSON-444271794-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:04:15.277907 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.manager [None req-73be13b7-ee9f-443c-ab78-135aa89500be tempest-AttachVolumeNegativeTest-284052145 tempest-AttachVolumeNegativeTest-284052145-project] Took 0.74 seconds to select destinations for 1 instance(s). {{(pid=98844) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 14:04:15.351786 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-73be13b7-ee9f-443c-ab78-135aa89500be tempest-AttachVolumeNegativeTest-284052145 tempest-AttachVolumeNegativeTest-284052145-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:04:15.352777 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-73be13b7-ee9f-443c-ab78-135aa89500be tempest-AttachVolumeNegativeTest-284052145 tempest-AttachVolumeNegativeTest-284052145-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:04:15.503388 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-73be13b7-ee9f-443c-ab78-135aa89500be tempest-AttachVolumeNegativeTest-284052145 tempest-AttachVolumeNegativeTest-284052145-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:04:15.514756 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-73be13b7-ee9f-443c-ab78-135aa89500be tempest-AttachVolumeNegativeTest-284052145 tempest-AttachVolumeNegativeTest-284052145-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:04:15.517555 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-73be13b7-ee9f-443c-ab78-135aa89500be tempest-AttachVolumeNegativeTest-284052145 tempest-AttachVolumeNegativeTest-284052145-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:04:15.520509 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-73be13b7-ee9f-443c-ab78-135aa89500be tempest-AttachVolumeNegativeTest-284052145 tempest-AttachVolumeNegativeTest-284052145-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:04:15.617715 n-d-791503-6 nova-conductor[98844]: DEBUG nova.quota [None req-73be13b7-ee9f-443c-ab78-135aa89500be tempest-AttachVolumeNegativeTest-284052145 tempest-AttachVolumeNegativeTest-284052145-project] Getting quotas for project 38e2f70489a14594b3542be2e70081ee. Resources: {'cores', 'ram', 'instances'} {{(pid=98844) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 14:04:15.649118 n-d-791503-6 nova-conductor[98844]: DEBUG nova.quota [None req-73be13b7-ee9f-443c-ab78-135aa89500be tempest-AttachVolumeNegativeTest-284052145 tempest-AttachVolumeNegativeTest-284052145-project] Getting quotas for user 64edfcac5b2b4a7d9b9d7a544a837586 and project 38e2f70489a14594b3542be2e70081ee. Resources: {'cores', 'ram', 'instances'} {{(pid=98844) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 14:04:15.695776 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.manager [None req-73be13b7-ee9f-443c-ab78-135aa89500be tempest-AttachVolumeNegativeTest-284052145 tempest-AttachVolumeNegativeTest-284052145-project] [instance: 27bb79d5-1bf1-4db7-8e7e-5fdc15d0628d] Selected host: n-h1-791503-6; Selected node: n-h1-791503-6; Alternates: [('n-h2-791503-6', 'n-h2-791503-6')] {{(pid=98844) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 14:04:15.697737 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-73be13b7-ee9f-443c-ab78-135aa89500be tempest-AttachVolumeNegativeTest-284052145 tempest-AttachVolumeNegativeTest-284052145-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:04:15.698386 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-73be13b7-ee9f-443c-ab78-135aa89500be tempest-AttachVolumeNegativeTest-284052145 tempest-AttachVolumeNegativeTest-284052145-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:04:15.750104 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.manager [None req-73be13b7-ee9f-443c-ab78-135aa89500be tempest-AttachVolumeNegativeTest-284052145 tempest-AttachVolumeNegativeTest-284052145-project] [instance: 27bb79d5-1bf1-4db7-8e7e-5fdc15d0628d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='64f6036b-99a9-40e4-8963-3cdf66964954',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98844) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 14:04:15.756759 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-73be13b7-ee9f-443c-ab78-135aa89500be tempest-AttachVolumeNegativeTest-284052145 tempest-AttachVolumeNegativeTest-284052145-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:04:15.758655 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-73be13b7-ee9f-443c-ab78-135aa89500be tempest-AttachVolumeNegativeTest-284052145 tempest-AttachVolumeNegativeTest-284052145-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:04:15.854744 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-73be13b7-ee9f-443c-ab78-135aa89500be tempest-AttachVolumeNegativeTest-284052145 tempest-AttachVolumeNegativeTest-284052145-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:04:15.855819 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-73be13b7-ee9f-443c-ab78-135aa89500be tempest-AttachVolumeNegativeTest-284052145 tempest-AttachVolumeNegativeTest-284052145-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:04:45.335579 n-d-791503-6 nova-conductor[98843]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 14:04:54.574130 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-1661f78c-19ba-4865-bebc-04069d0e420c tempest-ListServersNegativeTestJSON-1313118443 tempest-ListServersNegativeTestJSON-1313118443-project] Took 1.15 seconds to select destinations for 3 instance(s). {{(pid=98843) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 14:04:54.630567 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-1661f78c-19ba-4865-bebc-04069d0e420c tempest-ListServersNegativeTestJSON-1313118443 tempest-ListServersNegativeTestJSON-1313118443-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:04:54.633852 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-1661f78c-19ba-4865-bebc-04069d0e420c tempest-ListServersNegativeTestJSON-1313118443 tempest-ListServersNegativeTestJSON-1313118443-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:04:54.841076 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-1661f78c-19ba-4865-bebc-04069d0e420c tempest-ListServersNegativeTestJSON-1313118443 tempest-ListServersNegativeTestJSON-1313118443-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:04:54.841510 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-1661f78c-19ba-4865-bebc-04069d0e420c tempest-ListServersNegativeTestJSON-1313118443 tempest-ListServersNegativeTestJSON-1313118443-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:04:55.010875 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-1661f78c-19ba-4865-bebc-04069d0e420c tempest-ListServersNegativeTestJSON-1313118443 tempest-ListServersNegativeTestJSON-1313118443-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:04:55.011573 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-1661f78c-19ba-4865-bebc-04069d0e420c tempest-ListServersNegativeTestJSON-1313118443 tempest-ListServersNegativeTestJSON-1313118443-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:04:55.086840 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-1661f78c-19ba-4865-bebc-04069d0e420c tempest-ListServersNegativeTestJSON-1313118443 tempest-ListServersNegativeTestJSON-1313118443-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:04:55.087595 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-1661f78c-19ba-4865-bebc-04069d0e420c tempest-ListServersNegativeTestJSON-1313118443 tempest-ListServersNegativeTestJSON-1313118443-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:04:55.088544 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-1661f78c-19ba-4865-bebc-04069d0e420c tempest-ListServersNegativeTestJSON-1313118443 tempest-ListServersNegativeTestJSON-1313118443-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:04:55.089096 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-1661f78c-19ba-4865-bebc-04069d0e420c tempest-ListServersNegativeTestJSON-1313118443 tempest-ListServersNegativeTestJSON-1313118443-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:04:55.111908 n-d-791503-6 nova-conductor[98843]: DEBUG nova.quota [None req-1661f78c-19ba-4865-bebc-04069d0e420c tempest-ListServersNegativeTestJSON-1313118443 tempest-ListServersNegativeTestJSON-1313118443-project] Getting quotas for project e1bbf0439bc442a7b066ddf42a111657. Resources: {'cores', 'ram', 'instances'} {{(pid=98843) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 14:04:55.120797 n-d-791503-6 nova-conductor[98843]: DEBUG nova.quota [None req-1661f78c-19ba-4865-bebc-04069d0e420c tempest-ListServersNegativeTestJSON-1313118443 tempest-ListServersNegativeTestJSON-1313118443-project] Getting quotas for user 27e299e1de574684a48ac0d990f406c7 and project e1bbf0439bc442a7b066ddf42a111657. Resources: {'cores', 'ram', 'instances'} {{(pid=98843) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 14:04:55.135819 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-1661f78c-19ba-4865-bebc-04069d0e420c tempest-ListServersNegativeTestJSON-1313118443 tempest-ListServersNegativeTestJSON-1313118443-project] [instance: 3cd9c618-c7d7-47b0-9754-42a3a7acf8be] Selected host: n-h2-791503-6; Selected node: n-h2-791503-6; Alternates: [] {{(pid=98843) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 14:04:55.137992 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-1661f78c-19ba-4865-bebc-04069d0e420c tempest-ListServersNegativeTestJSON-1313118443 tempest-ListServersNegativeTestJSON-1313118443-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:04:55.138746 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-1661f78c-19ba-4865-bebc-04069d0e420c tempest-ListServersNegativeTestJSON-1313118443 tempest-ListServersNegativeTestJSON-1313118443-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:04:55.152934 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-1661f78c-19ba-4865-bebc-04069d0e420c tempest-ListServersNegativeTestJSON-1313118443 tempest-ListServersNegativeTestJSON-1313118443-project] [instance: 3cd9c618-c7d7-47b0-9754-42a3a7acf8be] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='64f6036b-99a9-40e4-8963-3cdf66964954',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98843) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 14:04:55.154761 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-1661f78c-19ba-4865-bebc-04069d0e420c tempest-ListServersNegativeTestJSON-1313118443 tempest-ListServersNegativeTestJSON-1313118443-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:04:55.155544 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-1661f78c-19ba-4865-bebc-04069d0e420c tempest-ListServersNegativeTestJSON-1313118443 tempest-ListServersNegativeTestJSON-1313118443-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:04:55.215756 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-1661f78c-19ba-4865-bebc-04069d0e420c tempest-ListServersNegativeTestJSON-1313118443 tempest-ListServersNegativeTestJSON-1313118443-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:04:55.216648 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-1661f78c-19ba-4865-bebc-04069d0e420c tempest-ListServersNegativeTestJSON-1313118443 tempest-ListServersNegativeTestJSON-1313118443-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:04:55.231100 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-1661f78c-19ba-4865-bebc-04069d0e420c tempest-ListServersNegativeTestJSON-1313118443 tempest-ListServersNegativeTestJSON-1313118443-project] [instance: 23d0254a-bebf-4533-97a6-6a0244f2e271] Selected host: n-h2-791503-6; Selected node: n-h2-791503-6; Alternates: [] {{(pid=98843) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 14:04:55.232621 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-1661f78c-19ba-4865-bebc-04069d0e420c tempest-ListServersNegativeTestJSON-1313118443 tempest-ListServersNegativeTestJSON-1313118443-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:04:55.233228 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-1661f78c-19ba-4865-bebc-04069d0e420c tempest-ListServersNegativeTestJSON-1313118443 tempest-ListServersNegativeTestJSON-1313118443-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:04:55.247153 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-1661f78c-19ba-4865-bebc-04069d0e420c tempest-ListServersNegativeTestJSON-1313118443 tempest-ListServersNegativeTestJSON-1313118443-project] [instance: 23d0254a-bebf-4533-97a6-6a0244f2e271] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='64f6036b-99a9-40e4-8963-3cdf66964954',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98843) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 14:04:55.249586 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-1661f78c-19ba-4865-bebc-04069d0e420c tempest-ListServersNegativeTestJSON-1313118443 tempest-ListServersNegativeTestJSON-1313118443-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:04:55.250469 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-1661f78c-19ba-4865-bebc-04069d0e420c tempest-ListServersNegativeTestJSON-1313118443 tempest-ListServersNegativeTestJSON-1313118443-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:04:55.305228 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-1661f78c-19ba-4865-bebc-04069d0e420c tempest-ListServersNegativeTestJSON-1313118443 tempest-ListServersNegativeTestJSON-1313118443-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:04:55.305908 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-1661f78c-19ba-4865-bebc-04069d0e420c tempest-ListServersNegativeTestJSON-1313118443 tempest-ListServersNegativeTestJSON-1313118443-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:04:55.320972 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-1661f78c-19ba-4865-bebc-04069d0e420c tempest-ListServersNegativeTestJSON-1313118443 tempest-ListServersNegativeTestJSON-1313118443-project] [instance: 08c91cd2-002f-4093-b0b1-d0b3b3c9732f] Selected host: n-h1-791503-6; Selected node: n-h1-791503-6; Alternates: [] {{(pid=98843) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 14:04:55.322224 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-1661f78c-19ba-4865-bebc-04069d0e420c tempest-ListServersNegativeTestJSON-1313118443 tempest-ListServersNegativeTestJSON-1313118443-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:04:55.322786 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-1661f78c-19ba-4865-bebc-04069d0e420c tempest-ListServersNegativeTestJSON-1313118443 tempest-ListServersNegativeTestJSON-1313118443-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:04:55.345921 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-1661f78c-19ba-4865-bebc-04069d0e420c tempest-ListServersNegativeTestJSON-1313118443 tempest-ListServersNegativeTestJSON-1313118443-project] [instance: 08c91cd2-002f-4093-b0b1-d0b3b3c9732f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='64f6036b-99a9-40e4-8963-3cdf66964954',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98843) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 14:04:55.348019 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-1661f78c-19ba-4865-bebc-04069d0e420c tempest-ListServersNegativeTestJSON-1313118443 tempest-ListServersNegativeTestJSON-1313118443-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:04:55.348726 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-1661f78c-19ba-4865-bebc-04069d0e420c tempest-ListServersNegativeTestJSON-1313118443 tempest-ListServersNegativeTestJSON-1313118443-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:04:55.447595 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-1661f78c-19ba-4865-bebc-04069d0e420c tempest-ListServersNegativeTestJSON-1313118443 tempest-ListServersNegativeTestJSON-1313118443-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:04:55.448037 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-1661f78c-19ba-4865-bebc-04069d0e420c tempest-ListServersNegativeTestJSON-1313118443 tempest-ListServersNegativeTestJSON-1313118443-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:05:15.972469 n-d-791503-6 nova-conductor[98844]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 14:05:34.530778 n-d-791503-6 nova-conductor[98844]: ERROR oslo.messaging._drivers.impl_rabbit [-] [cbd7c90c-b59a-4f8b-992f-d04ba5ad6f9c] AMQP server on 10.222.0.68:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection May 28 14:05:35.165452 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.manager [None req-5e84cef9-539d-4b8a-94b9-5b4588798dfd tempest-AttachVolumeNegativeTest-284052145 tempest-AttachVolumeNegativeTest-284052145-project] Took 0.98 seconds to select destinations for 1 instance(s). {{(pid=98844) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 14:05:35.301994 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-5e84cef9-539d-4b8a-94b9-5b4588798dfd tempest-AttachVolumeNegativeTest-284052145 tempest-AttachVolumeNegativeTest-284052145-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:05:35.303211 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-5e84cef9-539d-4b8a-94b9-5b4588798dfd tempest-AttachVolumeNegativeTest-284052145 tempest-AttachVolumeNegativeTest-284052145-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:05:35.547685 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-5e84cef9-539d-4b8a-94b9-5b4588798dfd tempest-AttachVolumeNegativeTest-284052145 tempest-AttachVolumeNegativeTest-284052145-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:05:35.548746 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-5e84cef9-539d-4b8a-94b9-5b4588798dfd tempest-AttachVolumeNegativeTest-284052145 tempest-AttachVolumeNegativeTest-284052145-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:05:35.567372 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-5e84cef9-539d-4b8a-94b9-5b4588798dfd tempest-AttachVolumeNegativeTest-284052145 tempest-AttachVolumeNegativeTest-284052145-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:05:35.567949 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-5e84cef9-539d-4b8a-94b9-5b4588798dfd tempest-AttachVolumeNegativeTest-284052145 tempest-AttachVolumeNegativeTest-284052145-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:05:35.708110 n-d-791503-6 nova-conductor[98844]: INFO oslo.messaging._drivers.impl_rabbit [-] [cbd7c90c-b59a-4f8b-992f-d04ba5ad6f9c] Reconnected to AMQP server on 10.222.0.68:5672 via [amqp] client with port 55144. May 28 14:05:35.716986 n-d-791503-6 nova-conductor[98844]: DEBUG nova.quota [None req-5e84cef9-539d-4b8a-94b9-5b4588798dfd tempest-AttachVolumeNegativeTest-284052145 tempest-AttachVolumeNegativeTest-284052145-project] Getting quotas for project 38e2f70489a14594b3542be2e70081ee. Resources: {'cores', 'ram', 'instances'} {{(pid=98844) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 14:05:35.737636 n-d-791503-6 nova-conductor[98844]: DEBUG nova.quota [None req-5e84cef9-539d-4b8a-94b9-5b4588798dfd tempest-AttachVolumeNegativeTest-284052145 tempest-AttachVolumeNegativeTest-284052145-project] Getting quotas for user 64edfcac5b2b4a7d9b9d7a544a837586 and project 38e2f70489a14594b3542be2e70081ee. Resources: {'cores', 'ram', 'instances'} {{(pid=98844) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 14:05:35.783693 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.manager [None req-5e84cef9-539d-4b8a-94b9-5b4588798dfd tempest-AttachVolumeNegativeTest-284052145 tempest-AttachVolumeNegativeTest-284052145-project] [instance: 830b4b6a-e10e-4c00-9f02-38dd4dd69f8e] Selected host: n-h1-791503-6; Selected node: n-h1-791503-6; Alternates: [('n-h2-791503-6', 'n-h2-791503-6')] {{(pid=98844) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 14:05:35.785637 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-5e84cef9-539d-4b8a-94b9-5b4588798dfd tempest-AttachVolumeNegativeTest-284052145 tempest-AttachVolumeNegativeTest-284052145-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:05:35.788382 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-5e84cef9-539d-4b8a-94b9-5b4588798dfd tempest-AttachVolumeNegativeTest-284052145 tempest-AttachVolumeNegativeTest-284052145-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:05:35.811415 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.manager [None req-5e84cef9-539d-4b8a-94b9-5b4588798dfd tempest-AttachVolumeNegativeTest-284052145 tempest-AttachVolumeNegativeTest-284052145-project] [instance: 830b4b6a-e10e-4c00-9f02-38dd4dd69f8e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='64f6036b-99a9-40e4-8963-3cdf66964954',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98844) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 14:05:35.814260 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-5e84cef9-539d-4b8a-94b9-5b4588798dfd tempest-AttachVolumeNegativeTest-284052145 tempest-AttachVolumeNegativeTest-284052145-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:05:35.815286 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-5e84cef9-539d-4b8a-94b9-5b4588798dfd tempest-AttachVolumeNegativeTest-284052145 tempest-AttachVolumeNegativeTest-284052145-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:05:35.943724 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-5e84cef9-539d-4b8a-94b9-5b4588798dfd tempest-AttachVolumeNegativeTest-284052145 tempest-AttachVolumeNegativeTest-284052145-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:05:35.944584 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-5e84cef9-539d-4b8a-94b9-5b4588798dfd tempest-AttachVolumeNegativeTest-284052145 tempest-AttachVolumeNegativeTest-284052145-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:06:26.162069 n-d-791503-6 nova-conductor[98843]: ERROR oslo.messaging._drivers.impl_rabbit [-] [fb67aa64-250d-4c34-b696-14a5dd0b49b6] AMQP server on 10.222.0.68:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection May 28 14:06:27.208264 n-d-791503-6 nova-conductor[98843]: INFO oslo.messaging._drivers.impl_rabbit [-] [fb67aa64-250d-4c34-b696-14a5dd0b49b6] Reconnected to AMQP server on 10.222.0.68:5672 via [amqp] client with port 56318. May 28 14:06:32.260367 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-15e19863-a8f2-44b8-853d-f0df0e2bf42d tempest-AttachVolumeNegativeTest-284052145 tempest-AttachVolumeNegativeTest-284052145-project] Took 0.54 seconds to select destinations for 1 instance(s). {{(pid=98843) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 14:06:32.371279 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-15e19863-a8f2-44b8-853d-f0df0e2bf42d tempest-AttachVolumeNegativeTest-284052145 tempest-AttachVolumeNegativeTest-284052145-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:06:32.372448 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-15e19863-a8f2-44b8-853d-f0df0e2bf42d tempest-AttachVolumeNegativeTest-284052145 tempest-AttachVolumeNegativeTest-284052145-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:06:32.508473 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-15e19863-a8f2-44b8-853d-f0df0e2bf42d tempest-AttachVolumeNegativeTest-284052145 tempest-AttachVolumeNegativeTest-284052145-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:06:32.509601 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-15e19863-a8f2-44b8-853d-f0df0e2bf42d tempest-AttachVolumeNegativeTest-284052145 tempest-AttachVolumeNegativeTest-284052145-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:06:32.511444 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-15e19863-a8f2-44b8-853d-f0df0e2bf42d tempest-AttachVolumeNegativeTest-284052145 tempest-AttachVolumeNegativeTest-284052145-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:06:32.512416 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-15e19863-a8f2-44b8-853d-f0df0e2bf42d tempest-AttachVolumeNegativeTest-284052145 tempest-AttachVolumeNegativeTest-284052145-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:06:32.552397 n-d-791503-6 nova-conductor[98843]: DEBUG nova.quota [None req-15e19863-a8f2-44b8-853d-f0df0e2bf42d tempest-AttachVolumeNegativeTest-284052145 tempest-AttachVolumeNegativeTest-284052145-project] Getting quotas for project 38e2f70489a14594b3542be2e70081ee. Resources: {'cores', 'ram', 'instances'} {{(pid=98843) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 14:06:32.561877 n-d-791503-6 nova-conductor[98843]: DEBUG nova.quota [None req-15e19863-a8f2-44b8-853d-f0df0e2bf42d tempest-AttachVolumeNegativeTest-284052145 tempest-AttachVolumeNegativeTest-284052145-project] Getting quotas for user 64edfcac5b2b4a7d9b9d7a544a837586 and project 38e2f70489a14594b3542be2e70081ee. Resources: {'cores', 'ram', 'instances'} {{(pid=98843) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 14:06:32.593582 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-15e19863-a8f2-44b8-853d-f0df0e2bf42d tempest-AttachVolumeNegativeTest-284052145 tempest-AttachVolumeNegativeTest-284052145-project] [instance: 9bf2e1e7-63a8-45cc-9b06-bf60550756d9] Selected host: n-h2-791503-6; Selected node: n-h2-791503-6; Alternates: [('n-h1-791503-6', 'n-h1-791503-6')] {{(pid=98843) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 14:06:32.596938 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-15e19863-a8f2-44b8-853d-f0df0e2bf42d tempest-AttachVolumeNegativeTest-284052145 tempest-AttachVolumeNegativeTest-284052145-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:06:32.599932 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-15e19863-a8f2-44b8-853d-f0df0e2bf42d tempest-AttachVolumeNegativeTest-284052145 tempest-AttachVolumeNegativeTest-284052145-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:06:32.645999 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-15e19863-a8f2-44b8-853d-f0df0e2bf42d tempest-AttachVolumeNegativeTest-284052145 tempest-AttachVolumeNegativeTest-284052145-project] [instance: 9bf2e1e7-63a8-45cc-9b06-bf60550756d9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='64f6036b-99a9-40e4-8963-3cdf66964954',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98843) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 14:06:32.648940 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-15e19863-a8f2-44b8-853d-f0df0e2bf42d tempest-AttachVolumeNegativeTest-284052145 tempest-AttachVolumeNegativeTest-284052145-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:06:32.650147 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-15e19863-a8f2-44b8-853d-f0df0e2bf42d tempest-AttachVolumeNegativeTest-284052145 tempest-AttachVolumeNegativeTest-284052145-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:06:32.742561 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-15e19863-a8f2-44b8-853d-f0df0e2bf42d tempest-AttachVolumeNegativeTest-284052145 tempest-AttachVolumeNegativeTest-284052145-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:06:32.743637 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-15e19863-a8f2-44b8-853d-f0df0e2bf42d tempest-AttachVolumeNegativeTest-284052145 tempest-AttachVolumeNegativeTest-284052145-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:06:45.632500 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-7512fc84-2769-4002-bad3-0ec905a5280d tempest-ServerGroupTestJSON-1694199799 tempest-ServerGroupTestJSON-1694199799-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:06:45.634371 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-7512fc84-2769-4002-bad3-0ec905a5280d tempest-ServerGroupTestJSON-1694199799 tempest-ServerGroupTestJSON-1694199799-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:06:46.578745 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.manager [None req-7512fc84-2769-4002-bad3-0ec905a5280d tempest-ServerGroupTestJSON-1694199799 tempest-ServerGroupTestJSON-1694199799-project] Took 0.86 seconds to select destinations for 1 instance(s). {{(pid=98844) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 14:06:46.669844 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-7512fc84-2769-4002-bad3-0ec905a5280d tempest-ServerGroupTestJSON-1694199799 tempest-ServerGroupTestJSON-1694199799-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:06:46.670526 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-7512fc84-2769-4002-bad3-0ec905a5280d tempest-ServerGroupTestJSON-1694199799 tempest-ServerGroupTestJSON-1694199799-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:06:46.863999 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-7512fc84-2769-4002-bad3-0ec905a5280d tempest-ServerGroupTestJSON-1694199799 tempest-ServerGroupTestJSON-1694199799-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:06:46.866554 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-7512fc84-2769-4002-bad3-0ec905a5280d tempest-ServerGroupTestJSON-1694199799 tempest-ServerGroupTestJSON-1694199799-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:06:46.870845 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-7512fc84-2769-4002-bad3-0ec905a5280d tempest-ServerGroupTestJSON-1694199799 tempest-ServerGroupTestJSON-1694199799-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:06:46.871700 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-7512fc84-2769-4002-bad3-0ec905a5280d tempest-ServerGroupTestJSON-1694199799 tempest-ServerGroupTestJSON-1694199799-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:06:46.944421 n-d-791503-6 nova-conductor[98844]: DEBUG nova.quota [None req-7512fc84-2769-4002-bad3-0ec905a5280d tempest-ServerGroupTestJSON-1694199799 tempest-ServerGroupTestJSON-1694199799-project] Getting quotas for project 972b8159a76742f082fa4ba99923c323. Resources: {'cores', 'ram', 'instances'} {{(pid=98844) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 14:06:46.956307 n-d-791503-6 nova-conductor[98844]: DEBUG nova.quota [None req-7512fc84-2769-4002-bad3-0ec905a5280d tempest-ServerGroupTestJSON-1694199799 tempest-ServerGroupTestJSON-1694199799-project] Getting quotas for user adaa506b3bb54d2cbc8984a92f331d65 and project 972b8159a76742f082fa4ba99923c323. Resources: {'cores', 'ram', 'instances'} {{(pid=98844) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 14:06:46.975736 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.manager [None req-7512fc84-2769-4002-bad3-0ec905a5280d tempest-ServerGroupTestJSON-1694199799 tempest-ServerGroupTestJSON-1694199799-project] [instance: fadb8f50-f824-41d6-a36e-21b21b566317] Selected host: n-h2-791503-6; Selected node: n-h2-791503-6; Alternates: [('n-h1-791503-6', 'n-h1-791503-6')] {{(pid=98844) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 14:06:46.977778 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-7512fc84-2769-4002-bad3-0ec905a5280d tempest-ServerGroupTestJSON-1694199799 tempest-ServerGroupTestJSON-1694199799-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:06:46.978401 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-7512fc84-2769-4002-bad3-0ec905a5280d tempest-ServerGroupTestJSON-1694199799 tempest-ServerGroupTestJSON-1694199799-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:06:46.991000 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.manager [None req-7512fc84-2769-4002-bad3-0ec905a5280d tempest-ServerGroupTestJSON-1694199799 tempest-ServerGroupTestJSON-1694199799-project] [instance: fadb8f50-f824-41d6-a36e-21b21b566317] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='64f6036b-99a9-40e4-8963-3cdf66964954',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98844) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 14:06:46.993230 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-7512fc84-2769-4002-bad3-0ec905a5280d tempest-ServerGroupTestJSON-1694199799 tempest-ServerGroupTestJSON-1694199799-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:06:46.994332 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-7512fc84-2769-4002-bad3-0ec905a5280d tempest-ServerGroupTestJSON-1694199799 tempest-ServerGroupTestJSON-1694199799-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:06:47.058355 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-7512fc84-2769-4002-bad3-0ec905a5280d tempest-ServerGroupTestJSON-1694199799 tempest-ServerGroupTestJSON-1694199799-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:06:47.059106 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-7512fc84-2769-4002-bad3-0ec905a5280d tempest-ServerGroupTestJSON-1694199799 tempest-ServerGroupTestJSON-1694199799-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:06:48.794713 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-b19d065d-eef0-4a26-8054-f056a924cd60 tempest-TestServerAdvancedOps-2033197683 tempest-TestServerAdvancedOps-2033197683-project] Took 0.89 seconds to select destinations for 1 instance(s). {{(pid=98843) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 14:06:48.907164 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-b19d065d-eef0-4a26-8054-f056a924cd60 tempest-TestServerAdvancedOps-2033197683 tempest-TestServerAdvancedOps-2033197683-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:06:48.910650 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-b19d065d-eef0-4a26-8054-f056a924cd60 tempest-TestServerAdvancedOps-2033197683 tempest-TestServerAdvancedOps-2033197683-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:06:49.100844 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-b19d065d-eef0-4a26-8054-f056a924cd60 tempest-TestServerAdvancedOps-2033197683 tempest-TestServerAdvancedOps-2033197683-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:06:49.101260 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-b19d065d-eef0-4a26-8054-f056a924cd60 tempest-TestServerAdvancedOps-2033197683 tempest-TestServerAdvancedOps-2033197683-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:06:49.102019 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-b19d065d-eef0-4a26-8054-f056a924cd60 tempest-TestServerAdvancedOps-2033197683 tempest-TestServerAdvancedOps-2033197683-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:06:49.102419 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-b19d065d-eef0-4a26-8054-f056a924cd60 tempest-TestServerAdvancedOps-2033197683 tempest-TestServerAdvancedOps-2033197683-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:06:49.153758 n-d-791503-6 nova-conductor[98843]: DEBUG nova.quota [None req-b19d065d-eef0-4a26-8054-f056a924cd60 tempest-TestServerAdvancedOps-2033197683 tempest-TestServerAdvancedOps-2033197683-project] Getting quotas for project f544ccb6a2094738a17290a07d98d333. Resources: {'cores', 'ram', 'instances'} {{(pid=98843) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 14:06:49.168877 n-d-791503-6 nova-conductor[98843]: DEBUG nova.quota [None req-b19d065d-eef0-4a26-8054-f056a924cd60 tempest-TestServerAdvancedOps-2033197683 tempest-TestServerAdvancedOps-2033197683-project] Getting quotas for user 77dbb4e96d834a2b86d4947a0d43f2a0 and project f544ccb6a2094738a17290a07d98d333. Resources: {'cores', 'ram', 'instances'} {{(pid=98843) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 14:06:49.188422 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-b19d065d-eef0-4a26-8054-f056a924cd60 tempest-TestServerAdvancedOps-2033197683 tempest-TestServerAdvancedOps-2033197683-project] [instance: 6583847e-0111-4064-bc35-591f27b1b4e1] Selected host: n-h1-791503-6; Selected node: n-h1-791503-6; Alternates: [('n-h2-791503-6', 'n-h2-791503-6')] {{(pid=98843) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 14:06:49.191745 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-b19d065d-eef0-4a26-8054-f056a924cd60 tempest-TestServerAdvancedOps-2033197683 tempest-TestServerAdvancedOps-2033197683-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:06:49.192737 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-b19d065d-eef0-4a26-8054-f056a924cd60 tempest-TestServerAdvancedOps-2033197683 tempest-TestServerAdvancedOps-2033197683-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:06:49.212963 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-b19d065d-eef0-4a26-8054-f056a924cd60 tempest-TestServerAdvancedOps-2033197683 tempest-TestServerAdvancedOps-2033197683-project] [instance: 6583847e-0111-4064-bc35-591f27b1b4e1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='64f6036b-99a9-40e4-8963-3cdf66964954',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98843) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 14:06:49.214405 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-b19d065d-eef0-4a26-8054-f056a924cd60 tempest-TestServerAdvancedOps-2033197683 tempest-TestServerAdvancedOps-2033197683-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:06:49.214914 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-b19d065d-eef0-4a26-8054-f056a924cd60 tempest-TestServerAdvancedOps-2033197683 tempest-TestServerAdvancedOps-2033197683-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:06:49.303274 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-b19d065d-eef0-4a26-8054-f056a924cd60 tempest-TestServerAdvancedOps-2033197683 tempest-TestServerAdvancedOps-2033197683-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:06:49.303731 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-b19d065d-eef0-4a26-8054-f056a924cd60 tempest-TestServerAdvancedOps-2033197683 tempest-TestServerAdvancedOps-2033197683-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:07:29.986293 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.manager [None req-c939f03a-32f7-40c3-9f32-bc06f14a348b tempest-TaggedBootDevicesTest-319846899 tempest-TaggedBootDevicesTest-319846899-project] Took 2.22 seconds to select destinations for 1 instance(s). {{(pid=98844) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 14:07:30.065060 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-c939f03a-32f7-40c3-9f32-bc06f14a348b tempest-TaggedBootDevicesTest-319846899 tempest-TaggedBootDevicesTest-319846899-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:07:30.065785 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-c939f03a-32f7-40c3-9f32-bc06f14a348b tempest-TaggedBootDevicesTest-319846899 tempest-TaggedBootDevicesTest-319846899-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:07:30.157910 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-e0839152-3d1d-4f47-bf83-751b79cae0d0 tempest-VolumesNegativeTest-2063361560 tempest-VolumesNegativeTest-2063361560-project] Took 2.09 seconds to select destinations for 1 instance(s). {{(pid=98843) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 14:07:30.217933 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-c939f03a-32f7-40c3-9f32-bc06f14a348b tempest-TaggedBootDevicesTest-319846899 tempest-TaggedBootDevicesTest-319846899-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:07:30.220191 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-c939f03a-32f7-40c3-9f32-bc06f14a348b tempest-TaggedBootDevicesTest-319846899 tempest-TaggedBootDevicesTest-319846899-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:07:30.224145 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-c939f03a-32f7-40c3-9f32-bc06f14a348b tempest-TaggedBootDevicesTest-319846899 tempest-TaggedBootDevicesTest-319846899-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:07:30.225565 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-c939f03a-32f7-40c3-9f32-bc06f14a348b tempest-TaggedBootDevicesTest-319846899 tempest-TaggedBootDevicesTest-319846899-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:07:30.227674 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-e0839152-3d1d-4f47-bf83-751b79cae0d0 tempest-VolumesNegativeTest-2063361560 tempest-VolumesNegativeTest-2063361560-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:07:30.229014 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-e0839152-3d1d-4f47-bf83-751b79cae0d0 tempest-VolumesNegativeTest-2063361560 tempest-VolumesNegativeTest-2063361560-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:07:30.274850 n-d-791503-6 nova-conductor[98844]: DEBUG nova.quota [None req-c939f03a-32f7-40c3-9f32-bc06f14a348b tempest-TaggedBootDevicesTest-319846899 tempest-TaggedBootDevicesTest-319846899-project] Getting quotas for project c696793a29b1426db10f701b8579378a. Resources: {'cores', 'ram', 'instances'} {{(pid=98844) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 14:07:30.294037 n-d-791503-6 nova-conductor[98844]: DEBUG nova.quota [None req-c939f03a-32f7-40c3-9f32-bc06f14a348b tempest-TaggedBootDevicesTest-319846899 tempest-TaggedBootDevicesTest-319846899-project] Getting quotas for user 55dbd32c667e4cc896d58f4699a1362c and project c696793a29b1426db10f701b8579378a. Resources: {'cores', 'ram', 'instances'} {{(pid=98844) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 14:07:30.379527 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.manager [None req-c939f03a-32f7-40c3-9f32-bc06f14a348b tempest-TaggedBootDevicesTest-319846899 tempest-TaggedBootDevicesTest-319846899-project] [instance: 7c2c3154-f5d0-4705-be1d-34a1a6e604d5] Selected host: n-h2-791503-6; Selected node: n-h2-791503-6; Alternates: [('n-h1-791503-6', 'n-h1-791503-6')] {{(pid=98844) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 14:07:30.381150 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-c939f03a-32f7-40c3-9f32-bc06f14a348b tempest-TaggedBootDevicesTest-319846899 tempest-TaggedBootDevicesTest-319846899-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:07:30.381811 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-c939f03a-32f7-40c3-9f32-bc06f14a348b tempest-TaggedBootDevicesTest-319846899 tempest-TaggedBootDevicesTest-319846899-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:07:30.396260 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-e0839152-3d1d-4f47-bf83-751b79cae0d0 tempest-VolumesNegativeTest-2063361560 tempest-VolumesNegativeTest-2063361560-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:07:30.399039 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-e0839152-3d1d-4f47-bf83-751b79cae0d0 tempest-VolumesNegativeTest-2063361560 tempest-VolumesNegativeTest-2063361560-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:07:30.401637 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.manager [None req-c939f03a-32f7-40c3-9f32-bc06f14a348b tempest-TaggedBootDevicesTest-319846899 tempest-TaggedBootDevicesTest-319846899-project] [instance: 7c2c3154-f5d0-4705-be1d-34a1a6e604d5] block_device_mapping [BlockDeviceMapping(attachment_id=91a15d9e-53ae-4fe4-acf0-58bf97d42a5c,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='4a7809d7-d688-45af-bc8c-69933a7bb0b2',volume_size=1,volume_type=None), BlockDeviceMapping(attachment_id=9e47ec64-4a7c-4455-8b53-4744121d2ece,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='fe6a67ec-71eb-411d-b6e9-dd765a319dc2',volume_size=1,volume_type=None), BlockDeviceMapping(attachment_id=02bd1519-ada9-4e08-be9a-c73d8304bedb,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='7c7bb4ce-46d2-45f3-85ff-950477fbfbf2',volume_size=1,volume_type=None)] {{(pid=98844) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 14:07:30.404479 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-e0839152-3d1d-4f47-bf83-751b79cae0d0 tempest-VolumesNegativeTest-2063361560 tempest-VolumesNegativeTest-2063361560-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:07:30.405262 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-c939f03a-32f7-40c3-9f32-bc06f14a348b tempest-TaggedBootDevicesTest-319846899 tempest-TaggedBootDevicesTest-319846899-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:07:30.406043 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-c939f03a-32f7-40c3-9f32-bc06f14a348b tempest-TaggedBootDevicesTest-319846899 tempest-TaggedBootDevicesTest-319846899-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:07:30.410366 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-e0839152-3d1d-4f47-bf83-751b79cae0d0 tempest-VolumesNegativeTest-2063361560 tempest-VolumesNegativeTest-2063361560-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:07:30.430609 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-c939f03a-32f7-40c3-9f32-bc06f14a348b tempest-TaggedBootDevicesTest-319846899 tempest-TaggedBootDevicesTest-319846899-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:07:30.435015 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-c939f03a-32f7-40c3-9f32-bc06f14a348b tempest-TaggedBootDevicesTest-319846899 tempest-TaggedBootDevicesTest-319846899-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:07:30.465127 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-c939f03a-32f7-40c3-9f32-bc06f14a348b tempest-TaggedBootDevicesTest-319846899 tempest-TaggedBootDevicesTest-319846899-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:07:30.466974 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-c939f03a-32f7-40c3-9f32-bc06f14a348b tempest-TaggedBootDevicesTest-319846899 tempest-TaggedBootDevicesTest-319846899-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:07:30.530655 n-d-791503-6 nova-conductor[98843]: DEBUG nova.quota [None req-e0839152-3d1d-4f47-bf83-751b79cae0d0 tempest-VolumesNegativeTest-2063361560 tempest-VolumesNegativeTest-2063361560-project] Getting quotas for project 193c7acab55346249b89f985591a6b28. Resources: {'cores', 'ram', 'instances'} {{(pid=98843) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 14:07:30.537444 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-c939f03a-32f7-40c3-9f32-bc06f14a348b tempest-TaggedBootDevicesTest-319846899 tempest-TaggedBootDevicesTest-319846899-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:07:30.538768 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-c939f03a-32f7-40c3-9f32-bc06f14a348b tempest-TaggedBootDevicesTest-319846899 tempest-TaggedBootDevicesTest-319846899-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:07:30.559817 n-d-791503-6 nova-conductor[98843]: DEBUG nova.quota [None req-e0839152-3d1d-4f47-bf83-751b79cae0d0 tempest-VolumesNegativeTest-2063361560 tempest-VolumesNegativeTest-2063361560-project] Getting quotas for user 2c8ce4a57a184cf189324b1cf3e8598f and project 193c7acab55346249b89f985591a6b28. Resources: {'cores', 'ram', 'instances'} {{(pid=98843) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 14:07:30.618881 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-e0839152-3d1d-4f47-bf83-751b79cae0d0 tempest-VolumesNegativeTest-2063361560 tempest-VolumesNegativeTest-2063361560-project] [instance: 768671ed-ddc2-451c-a8ca-a74032828a50] Selected host: n-h2-791503-6; Selected node: n-h2-791503-6; Alternates: [('n-h1-791503-6', 'n-h1-791503-6')] {{(pid=98843) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 14:07:30.622259 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-e0839152-3d1d-4f47-bf83-751b79cae0d0 tempest-VolumesNegativeTest-2063361560 tempest-VolumesNegativeTest-2063361560-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:07:30.623517 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-e0839152-3d1d-4f47-bf83-751b79cae0d0 tempest-VolumesNegativeTest-2063361560 tempest-VolumesNegativeTest-2063361560-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:07:30.648010 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-e0839152-3d1d-4f47-bf83-751b79cae0d0 tempest-VolumesNegativeTest-2063361560 tempest-VolumesNegativeTest-2063361560-project] [instance: 768671ed-ddc2-451c-a8ca-a74032828a50] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='64f6036b-99a9-40e4-8963-3cdf66964954',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98843) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 14:07:30.665182 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-e0839152-3d1d-4f47-bf83-751b79cae0d0 tempest-VolumesNegativeTest-2063361560 tempest-VolumesNegativeTest-2063361560-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:07:30.675765 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-e0839152-3d1d-4f47-bf83-751b79cae0d0 tempest-VolumesNegativeTest-2063361560 tempest-VolumesNegativeTest-2063361560-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:07:30.830499 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-e0839152-3d1d-4f47-bf83-751b79cae0d0 tempest-VolumesNegativeTest-2063361560 tempest-VolumesNegativeTest-2063361560-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:07:30.834158 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-e0839152-3d1d-4f47-bf83-751b79cae0d0 tempest-VolumesNegativeTest-2063361560 tempest-VolumesNegativeTest-2063361560-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:07:42.739006 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.manager [None req-6fe22cdb-504b-4d3a-99f5-aaeedfeadcb4 tempest-AttachVolumeNegativeTest-284052145 tempest-AttachVolumeNegativeTest-284052145-project] Took 0.86 seconds to select destinations for 1 instance(s). {{(pid=98844) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 14:07:42.796772 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-6fe22cdb-504b-4d3a-99f5-aaeedfeadcb4 tempest-AttachVolumeNegativeTest-284052145 tempest-AttachVolumeNegativeTest-284052145-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:07:42.797217 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-6fe22cdb-504b-4d3a-99f5-aaeedfeadcb4 tempest-AttachVolumeNegativeTest-284052145 tempest-AttachVolumeNegativeTest-284052145-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:07:42.915441 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-6fe22cdb-504b-4d3a-99f5-aaeedfeadcb4 tempest-AttachVolumeNegativeTest-284052145 tempest-AttachVolumeNegativeTest-284052145-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:07:42.915680 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-6fe22cdb-504b-4d3a-99f5-aaeedfeadcb4 tempest-AttachVolumeNegativeTest-284052145 tempest-AttachVolumeNegativeTest-284052145-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:07:42.916430 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-6fe22cdb-504b-4d3a-99f5-aaeedfeadcb4 tempest-AttachVolumeNegativeTest-284052145 tempest-AttachVolumeNegativeTest-284052145-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:07:42.916834 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-6fe22cdb-504b-4d3a-99f5-aaeedfeadcb4 tempest-AttachVolumeNegativeTest-284052145 tempest-AttachVolumeNegativeTest-284052145-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:07:42.962332 n-d-791503-6 nova-conductor[98844]: DEBUG nova.quota [None req-6fe22cdb-504b-4d3a-99f5-aaeedfeadcb4 tempest-AttachVolumeNegativeTest-284052145 tempest-AttachVolumeNegativeTest-284052145-project] Getting quotas for project 38e2f70489a14594b3542be2e70081ee. Resources: {'cores', 'ram', 'instances'} {{(pid=98844) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 14:07:42.981695 n-d-791503-6 nova-conductor[98844]: DEBUG nova.quota [None req-6fe22cdb-504b-4d3a-99f5-aaeedfeadcb4 tempest-AttachVolumeNegativeTest-284052145 tempest-AttachVolumeNegativeTest-284052145-project] Getting quotas for user 64edfcac5b2b4a7d9b9d7a544a837586 and project 38e2f70489a14594b3542be2e70081ee. Resources: {'cores', 'ram', 'instances'} {{(pid=98844) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 14:07:43.013972 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.manager [None req-6fe22cdb-504b-4d3a-99f5-aaeedfeadcb4 tempest-AttachVolumeNegativeTest-284052145 tempest-AttachVolumeNegativeTest-284052145-project] [instance: c5d7445d-5870-4ead-b6bd-8e5d8ebea202] Selected host: n-h1-791503-6; Selected node: n-h1-791503-6; Alternates: [('n-h2-791503-6', 'n-h2-791503-6')] {{(pid=98844) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 14:07:43.017000 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-6fe22cdb-504b-4d3a-99f5-aaeedfeadcb4 tempest-AttachVolumeNegativeTest-284052145 tempest-AttachVolumeNegativeTest-284052145-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:07:43.020590 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-6fe22cdb-504b-4d3a-99f5-aaeedfeadcb4 tempest-AttachVolumeNegativeTest-284052145 tempest-AttachVolumeNegativeTest-284052145-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:07:43.069769 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.manager [None req-6fe22cdb-504b-4d3a-99f5-aaeedfeadcb4 tempest-AttachVolumeNegativeTest-284052145 tempest-AttachVolumeNegativeTest-284052145-project] [instance: c5d7445d-5870-4ead-b6bd-8e5d8ebea202] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='64f6036b-99a9-40e4-8963-3cdf66964954',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98844) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 14:07:43.073274 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-6fe22cdb-504b-4d3a-99f5-aaeedfeadcb4 tempest-AttachVolumeNegativeTest-284052145 tempest-AttachVolumeNegativeTest-284052145-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:07:43.073986 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-6fe22cdb-504b-4d3a-99f5-aaeedfeadcb4 tempest-AttachVolumeNegativeTest-284052145 tempest-AttachVolumeNegativeTest-284052145-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:07:43.176024 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-6fe22cdb-504b-4d3a-99f5-aaeedfeadcb4 tempest-AttachVolumeNegativeTest-284052145 tempest-AttachVolumeNegativeTest-284052145-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:07:43.177692 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-6fe22cdb-504b-4d3a-99f5-aaeedfeadcb4 tempest-AttachVolumeNegativeTest-284052145 tempest-AttachVolumeNegativeTest-284052145-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:08:05.367930 n-d-791503-6 nova-conductor[98843]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 14:08:35.688331 n-d-791503-6 nova-conductor[98844]: ERROR oslo.messaging._drivers.impl_rabbit [-] [cbd7c90c-b59a-4f8b-992f-d04ba5ad6f9c] AMQP server on 10.222.0.68:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection May 28 14:08:36.024588 n-d-791503-6 nova-conductor[98844]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 14:08:36.733835 n-d-791503-6 nova-conductor[98844]: INFO oslo.messaging._drivers.impl_rabbit [-] [cbd7c90c-b59a-4f8b-992f-d04ba5ad6f9c] Reconnected to AMQP server on 10.222.0.68:5672 via [amqp] client with port 58928. May 28 14:08:41.660947 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-765cf9a5-9d34-42cb-a5f3-36294ae382f2 tempest-ServerRescueNegativeTestJSON-1852110536 tempest-ServerRescueNegativeTestJSON-1852110536-project] Took 0.95 seconds to select destinations for 1 instance(s). {{(pid=98843) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 14:08:41.795094 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-765cf9a5-9d34-42cb-a5f3-36294ae382f2 tempest-ServerRescueNegativeTestJSON-1852110536 tempest-ServerRescueNegativeTestJSON-1852110536-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:08:41.798832 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-765cf9a5-9d34-42cb-a5f3-36294ae382f2 tempest-ServerRescueNegativeTestJSON-1852110536 tempest-ServerRescueNegativeTestJSON-1852110536-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:08:42.029174 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-765cf9a5-9d34-42cb-a5f3-36294ae382f2 tempest-ServerRescueNegativeTestJSON-1852110536 tempest-ServerRescueNegativeTestJSON-1852110536-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:08:42.037736 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-765cf9a5-9d34-42cb-a5f3-36294ae382f2 tempest-ServerRescueNegativeTestJSON-1852110536 tempest-ServerRescueNegativeTestJSON-1852110536-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:08:42.043852 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-765cf9a5-9d34-42cb-a5f3-36294ae382f2 tempest-ServerRescueNegativeTestJSON-1852110536 tempest-ServerRescueNegativeTestJSON-1852110536-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:08:42.046299 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-765cf9a5-9d34-42cb-a5f3-36294ae382f2 tempest-ServerRescueNegativeTestJSON-1852110536 tempest-ServerRescueNegativeTestJSON-1852110536-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:08:42.125001 n-d-791503-6 nova-conductor[98843]: DEBUG nova.quota [None req-765cf9a5-9d34-42cb-a5f3-36294ae382f2 tempest-ServerRescueNegativeTestJSON-1852110536 tempest-ServerRescueNegativeTestJSON-1852110536-project] Getting quotas for project 34ca7ebefc1443849d8e0ab9ea6a90f9. Resources: {'cores', 'ram', 'instances'} {{(pid=98843) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 14:08:42.147409 n-d-791503-6 nova-conductor[98843]: DEBUG nova.quota [None req-765cf9a5-9d34-42cb-a5f3-36294ae382f2 tempest-ServerRescueNegativeTestJSON-1852110536 tempest-ServerRescueNegativeTestJSON-1852110536-project] Getting quotas for user cd516879948b44cab5c0d907df5c8f9d and project 34ca7ebefc1443849d8e0ab9ea6a90f9. Resources: {'cores', 'ram', 'instances'} {{(pid=98843) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 14:08:42.187415 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-765cf9a5-9d34-42cb-a5f3-36294ae382f2 tempest-ServerRescueNegativeTestJSON-1852110536 tempest-ServerRescueNegativeTestJSON-1852110536-project] [instance: 3ea814e6-e603-4f08-b58f-0549787cb679] Selected host: n-h2-791503-6; Selected node: n-h2-791503-6; Alternates: [('n-h1-791503-6', 'n-h1-791503-6')] {{(pid=98843) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 14:08:42.189471 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-765cf9a5-9d34-42cb-a5f3-36294ae382f2 tempest-ServerRescueNegativeTestJSON-1852110536 tempest-ServerRescueNegativeTestJSON-1852110536-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:08:42.190640 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-765cf9a5-9d34-42cb-a5f3-36294ae382f2 tempest-ServerRescueNegativeTestJSON-1852110536 tempest-ServerRescueNegativeTestJSON-1852110536-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:08:42.207559 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-765cf9a5-9d34-42cb-a5f3-36294ae382f2 tempest-ServerRescueNegativeTestJSON-1852110536 tempest-ServerRescueNegativeTestJSON-1852110536-project] [instance: 3ea814e6-e603-4f08-b58f-0549787cb679] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='64f6036b-99a9-40e4-8963-3cdf66964954',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98843) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 14:08:42.211887 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-765cf9a5-9d34-42cb-a5f3-36294ae382f2 tempest-ServerRescueNegativeTestJSON-1852110536 tempest-ServerRescueNegativeTestJSON-1852110536-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:08:42.214227 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-765cf9a5-9d34-42cb-a5f3-36294ae382f2 tempest-ServerRescueNegativeTestJSON-1852110536 tempest-ServerRescueNegativeTestJSON-1852110536-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:08:42.306835 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-765cf9a5-9d34-42cb-a5f3-36294ae382f2 tempest-ServerRescueNegativeTestJSON-1852110536 tempest-ServerRescueNegativeTestJSON-1852110536-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:08:42.307636 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-765cf9a5-9d34-42cb-a5f3-36294ae382f2 tempest-ServerRescueNegativeTestJSON-1852110536 tempest-ServerRescueNegativeTestJSON-1852110536-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:08:48.155396 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.manager [None req-6cb17e4b-69d2-40de-bd70-60a63f8e56dc tempest-ServerRescueNegativeTestJSON-1852110536 tempest-ServerRescueNegativeTestJSON-1852110536-project] Took 0.82 seconds to select destinations for 1 instance(s). {{(pid=98844) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 14:08:48.210079 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-6cb17e4b-69d2-40de-bd70-60a63f8e56dc tempest-ServerRescueNegativeTestJSON-1852110536 tempest-ServerRescueNegativeTestJSON-1852110536-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:08:48.219606 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-6cb17e4b-69d2-40de-bd70-60a63f8e56dc tempest-ServerRescueNegativeTestJSON-1852110536 tempest-ServerRescueNegativeTestJSON-1852110536-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:08:48.292188 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-6cb17e4b-69d2-40de-bd70-60a63f8e56dc tempest-ServerRescueNegativeTestJSON-1852110536 tempest-ServerRescueNegativeTestJSON-1852110536-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:08:48.293074 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-6cb17e4b-69d2-40de-bd70-60a63f8e56dc tempest-ServerRescueNegativeTestJSON-1852110536 tempest-ServerRescueNegativeTestJSON-1852110536-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:08:48.294099 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-6cb17e4b-69d2-40de-bd70-60a63f8e56dc tempest-ServerRescueNegativeTestJSON-1852110536 tempest-ServerRescueNegativeTestJSON-1852110536-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:08:48.294664 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-6cb17e4b-69d2-40de-bd70-60a63f8e56dc tempest-ServerRescueNegativeTestJSON-1852110536 tempest-ServerRescueNegativeTestJSON-1852110536-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:08:48.319645 n-d-791503-6 nova-conductor[98844]: DEBUG nova.quota [None req-6cb17e4b-69d2-40de-bd70-60a63f8e56dc tempest-ServerRescueNegativeTestJSON-1852110536 tempest-ServerRescueNegativeTestJSON-1852110536-project] Getting quotas for project 34ca7ebefc1443849d8e0ab9ea6a90f9. Resources: {'cores', 'ram', 'instances'} {{(pid=98844) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 14:08:48.325747 n-d-791503-6 nova-conductor[98844]: DEBUG nova.quota [None req-6cb17e4b-69d2-40de-bd70-60a63f8e56dc tempest-ServerRescueNegativeTestJSON-1852110536 tempest-ServerRescueNegativeTestJSON-1852110536-project] Getting quotas for user cd516879948b44cab5c0d907df5c8f9d and project 34ca7ebefc1443849d8e0ab9ea6a90f9. Resources: {'cores', 'ram', 'instances'} {{(pid=98844) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 14:08:48.378622 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.manager [None req-6cb17e4b-69d2-40de-bd70-60a63f8e56dc tempest-ServerRescueNegativeTestJSON-1852110536 tempest-ServerRescueNegativeTestJSON-1852110536-project] [instance: 72dd90fb-d1f1-4c50-84ae-087d0b6c38ca] Selected host: n-h1-791503-6; Selected node: n-h1-791503-6; Alternates: [('n-h2-791503-6', 'n-h2-791503-6')] {{(pid=98844) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 14:08:48.387386 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-6cb17e4b-69d2-40de-bd70-60a63f8e56dc tempest-ServerRescueNegativeTestJSON-1852110536 tempest-ServerRescueNegativeTestJSON-1852110536-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:08:48.388207 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-6cb17e4b-69d2-40de-bd70-60a63f8e56dc tempest-ServerRescueNegativeTestJSON-1852110536 tempest-ServerRescueNegativeTestJSON-1852110536-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:08:48.428425 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.manager [None req-6cb17e4b-69d2-40de-bd70-60a63f8e56dc tempest-ServerRescueNegativeTestJSON-1852110536 tempest-ServerRescueNegativeTestJSON-1852110536-project] [instance: 72dd90fb-d1f1-4c50-84ae-087d0b6c38ca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='64f6036b-99a9-40e4-8963-3cdf66964954',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98844) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 14:08:48.431407 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-6cb17e4b-69d2-40de-bd70-60a63f8e56dc tempest-ServerRescueNegativeTestJSON-1852110536 tempest-ServerRescueNegativeTestJSON-1852110536-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:08:48.432498 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-6cb17e4b-69d2-40de-bd70-60a63f8e56dc tempest-ServerRescueNegativeTestJSON-1852110536 tempest-ServerRescueNegativeTestJSON-1852110536-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:08:48.526198 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-6cb17e4b-69d2-40de-bd70-60a63f8e56dc tempest-ServerRescueNegativeTestJSON-1852110536 tempest-ServerRescueNegativeTestJSON-1852110536-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:08:48.526608 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-6cb17e4b-69d2-40de-bd70-60a63f8e56dc tempest-ServerRescueNegativeTestJSON-1852110536 tempest-ServerRescueNegativeTestJSON-1852110536-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:09:27.209039 n-d-791503-6 nova-conductor[98843]: ERROR oslo.messaging._drivers.impl_rabbit [-] [fb67aa64-250d-4c34-b696-14a5dd0b49b6] AMQP server on 10.222.0.68:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection May 28 14:09:28.268581 n-d-791503-6 nova-conductor[98843]: INFO oslo.messaging._drivers.impl_rabbit [-] [fb67aa64-250d-4c34-b696-14a5dd0b49b6] Reconnected to AMQP server on 10.222.0.68:5672 via [amqp] client with port 59688. May 28 14:10:07.558108 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-0df3beda-9e53-4e61-90e3-6c8eade2a75d tempest-TestVolumeBootPattern-1064630590 tempest-TestVolumeBootPattern-1064630590-project] Took 0.61 seconds to select destinations for 1 instance(s). {{(pid=98843) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 14:10:07.586096 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-0df3beda-9e53-4e61-90e3-6c8eade2a75d tempest-TestVolumeBootPattern-1064630590 tempest-TestVolumeBootPattern-1064630590-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:10:07.586902 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-0df3beda-9e53-4e61-90e3-6c8eade2a75d tempest-TestVolumeBootPattern-1064630590 tempest-TestVolumeBootPattern-1064630590-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:10:07.708488 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-0df3beda-9e53-4e61-90e3-6c8eade2a75d tempest-TestVolumeBootPattern-1064630590 tempest-TestVolumeBootPattern-1064630590-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:10:07.709074 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-0df3beda-9e53-4e61-90e3-6c8eade2a75d tempest-TestVolumeBootPattern-1064630590 tempest-TestVolumeBootPattern-1064630590-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:10:07.710090 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-0df3beda-9e53-4e61-90e3-6c8eade2a75d tempest-TestVolumeBootPattern-1064630590 tempest-TestVolumeBootPattern-1064630590-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:10:07.710567 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-0df3beda-9e53-4e61-90e3-6c8eade2a75d tempest-TestVolumeBootPattern-1064630590 tempest-TestVolumeBootPattern-1064630590-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:10:07.735578 n-d-791503-6 nova-conductor[98843]: DEBUG nova.quota [None req-0df3beda-9e53-4e61-90e3-6c8eade2a75d tempest-TestVolumeBootPattern-1064630590 tempest-TestVolumeBootPattern-1064630590-project] Getting quotas for project 305e3a203e4f4a6587868d912011ea19. Resources: {'cores', 'ram', 'instances'} {{(pid=98843) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 14:10:07.742109 n-d-791503-6 nova-conductor[98843]: DEBUG nova.quota [None req-0df3beda-9e53-4e61-90e3-6c8eade2a75d tempest-TestVolumeBootPattern-1064630590 tempest-TestVolumeBootPattern-1064630590-project] Getting quotas for user 4369165fbbb64bb194d32c8ca9624ca3 and project 305e3a203e4f4a6587868d912011ea19. Resources: {'cores', 'ram', 'instances'} {{(pid=98843) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 14:10:07.774665 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-0df3beda-9e53-4e61-90e3-6c8eade2a75d tempest-TestVolumeBootPattern-1064630590 tempest-TestVolumeBootPattern-1064630590-project] [instance: 15a6e3a5-424d-4c02-9bdc-d18ce0b3b6f2] Selected host: n-h1-791503-6; Selected node: n-h1-791503-6; Alternates: [('n-h2-791503-6', 'n-h2-791503-6')] {{(pid=98843) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 14:10:07.776185 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-0df3beda-9e53-4e61-90e3-6c8eade2a75d tempest-TestVolumeBootPattern-1064630590 tempest-TestVolumeBootPattern-1064630590-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:10:07.776782 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-0df3beda-9e53-4e61-90e3-6c8eade2a75d tempest-TestVolumeBootPattern-1064630590 tempest-TestVolumeBootPattern-1064630590-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:10:07.805397 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-0df3beda-9e53-4e61-90e3-6c8eade2a75d tempest-TestVolumeBootPattern-1064630590 tempest-TestVolumeBootPattern-1064630590-project] [instance: 15a6e3a5-424d-4c02-9bdc-d18ce0b3b6f2] block_device_mapping [BlockDeviceMapping(attachment_id=269ed549-c860-491c-a645-94b1d82bc6bd,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='0e8a8202-eb13-44bd-8c44-f317227ba04e',volume_size=1,volume_type=None)] {{(pid=98843) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 14:10:07.807786 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-0df3beda-9e53-4e61-90e3-6c8eade2a75d tempest-TestVolumeBootPattern-1064630590 tempest-TestVolumeBootPattern-1064630590-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:10:07.808472 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-0df3beda-9e53-4e61-90e3-6c8eade2a75d tempest-TestVolumeBootPattern-1064630590 tempest-TestVolumeBootPattern-1064630590-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:10:07.898868 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-0df3beda-9e53-4e61-90e3-6c8eade2a75d tempest-TestVolumeBootPattern-1064630590 tempest-TestVolumeBootPattern-1064630590-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:10:07.899319 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-0df3beda-9e53-4e61-90e3-6c8eade2a75d tempest-TestVolumeBootPattern-1064630590 tempest-TestVolumeBootPattern-1064630590-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:10:48.786217 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.manager [None req-bd5096b1-3d3c-476b-aa69-12082b01f8f2 tempest-VolumesSnapshotTestJSON-2119717970 tempest-VolumesSnapshotTestJSON-2119717970-project] Took 0.75 seconds to select destinations for 1 instance(s). {{(pid=98844) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 14:10:48.880635 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-bd5096b1-3d3c-476b-aa69-12082b01f8f2 tempest-VolumesSnapshotTestJSON-2119717970 tempest-VolumesSnapshotTestJSON-2119717970-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:10:48.881533 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-bd5096b1-3d3c-476b-aa69-12082b01f8f2 tempest-VolumesSnapshotTestJSON-2119717970 tempest-VolumesSnapshotTestJSON-2119717970-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:10:49.040392 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-bd5096b1-3d3c-476b-aa69-12082b01f8f2 tempest-VolumesSnapshotTestJSON-2119717970 tempest-VolumesSnapshotTestJSON-2119717970-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:10:49.044950 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-bd5096b1-3d3c-476b-aa69-12082b01f8f2 tempest-VolumesSnapshotTestJSON-2119717970 tempest-VolumesSnapshotTestJSON-2119717970-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:10:49.046331 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-bd5096b1-3d3c-476b-aa69-12082b01f8f2 tempest-VolumesSnapshotTestJSON-2119717970 tempest-VolumesSnapshotTestJSON-2119717970-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:10:49.046971 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-bd5096b1-3d3c-476b-aa69-12082b01f8f2 tempest-VolumesSnapshotTestJSON-2119717970 tempest-VolumesSnapshotTestJSON-2119717970-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:10:49.079842 n-d-791503-6 nova-conductor[98844]: DEBUG nova.quota [None req-bd5096b1-3d3c-476b-aa69-12082b01f8f2 tempest-VolumesSnapshotTestJSON-2119717970 tempest-VolumesSnapshotTestJSON-2119717970-project] Getting quotas for project e1e6f8a560b44d59b5583634db7a7836. Resources: {'cores', 'ram', 'instances'} {{(pid=98844) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 14:10:49.090213 n-d-791503-6 nova-conductor[98844]: DEBUG nova.quota [None req-bd5096b1-3d3c-476b-aa69-12082b01f8f2 tempest-VolumesSnapshotTestJSON-2119717970 tempest-VolumesSnapshotTestJSON-2119717970-project] Getting quotas for user 26f727d25dba43dfbbf0d016e8c7970a and project e1e6f8a560b44d59b5583634db7a7836. Resources: {'cores', 'ram', 'instances'} {{(pid=98844) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 14:10:49.132812 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.manager [None req-bd5096b1-3d3c-476b-aa69-12082b01f8f2 tempest-VolumesSnapshotTestJSON-2119717970 tempest-VolumesSnapshotTestJSON-2119717970-project] [instance: 72641792-affb-4876-8a60-a10967c341de] Selected host: n-h2-791503-6; Selected node: n-h2-791503-6; Alternates: [('n-h1-791503-6', 'n-h1-791503-6')] {{(pid=98844) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 14:10:49.134429 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-bd5096b1-3d3c-476b-aa69-12082b01f8f2 tempest-VolumesSnapshotTestJSON-2119717970 tempest-VolumesSnapshotTestJSON-2119717970-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:10:49.135049 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-bd5096b1-3d3c-476b-aa69-12082b01f8f2 tempest-VolumesSnapshotTestJSON-2119717970 tempest-VolumesSnapshotTestJSON-2119717970-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:10:49.147473 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.manager [None req-bd5096b1-3d3c-476b-aa69-12082b01f8f2 tempest-VolumesSnapshotTestJSON-2119717970 tempest-VolumesSnapshotTestJSON-2119717970-project] [instance: 72641792-affb-4876-8a60-a10967c341de] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='64f6036b-99a9-40e4-8963-3cdf66964954',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98844) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 14:10:49.153068 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-bd5096b1-3d3c-476b-aa69-12082b01f8f2 tempest-VolumesSnapshotTestJSON-2119717970 tempest-VolumesSnapshotTestJSON-2119717970-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:10:49.154993 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-bd5096b1-3d3c-476b-aa69-12082b01f8f2 tempest-VolumesSnapshotTestJSON-2119717970 tempest-VolumesSnapshotTestJSON-2119717970-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:10:49.248763 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-bd5096b1-3d3c-476b-aa69-12082b01f8f2 tempest-VolumesSnapshotTestJSON-2119717970 tempest-VolumesSnapshotTestJSON-2119717970-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:10:49.249430 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-bd5096b1-3d3c-476b-aa69-12082b01f8f2 tempest-VolumesSnapshotTestJSON-2119717970 tempest-VolumesSnapshotTestJSON-2119717970-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:11:25.404662 n-d-791503-6 nova-conductor[98843]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 14:11:36.735851 n-d-791503-6 nova-conductor[98844]: ERROR oslo.messaging._drivers.impl_rabbit [-] [cbd7c90c-b59a-4f8b-992f-d04ba5ad6f9c] AMQP server on 10.222.0.68:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection May 28 14:11:37.795188 n-d-791503-6 nova-conductor[98844]: INFO oslo.messaging._drivers.impl_rabbit [-] [cbd7c90c-b59a-4f8b-992f-d04ba5ad6f9c] Reconnected to AMQP server on 10.222.0.68:5672 via [amqp] client with port 35030. May 28 14:11:56.077083 n-d-791503-6 nova-conductor[98844]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 14:12:11.555280 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-71a8813a-4736-4157-8d59-605521f67c0f tempest-TestVolumeBootPattern-1064630590 tempest-TestVolumeBootPattern-1064630590-project] Took 0.45 seconds to select destinations for 1 instance(s). {{(pid=98843) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 14:12:11.588085 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-71a8813a-4736-4157-8d59-605521f67c0f tempest-TestVolumeBootPattern-1064630590 tempest-TestVolumeBootPattern-1064630590-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:12:11.588869 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-71a8813a-4736-4157-8d59-605521f67c0f tempest-TestVolumeBootPattern-1064630590 tempest-TestVolumeBootPattern-1064630590-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:12:11.651871 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-71a8813a-4736-4157-8d59-605521f67c0f tempest-TestVolumeBootPattern-1064630590 tempest-TestVolumeBootPattern-1064630590-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:12:11.652681 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-71a8813a-4736-4157-8d59-605521f67c0f tempest-TestVolumeBootPattern-1064630590 tempest-TestVolumeBootPattern-1064630590-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:12:11.653791 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-71a8813a-4736-4157-8d59-605521f67c0f tempest-TestVolumeBootPattern-1064630590 tempest-TestVolumeBootPattern-1064630590-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:12:11.654377 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-71a8813a-4736-4157-8d59-605521f67c0f tempest-TestVolumeBootPattern-1064630590 tempest-TestVolumeBootPattern-1064630590-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:12:11.680973 n-d-791503-6 nova-conductor[98843]: DEBUG nova.quota [None req-71a8813a-4736-4157-8d59-605521f67c0f tempest-TestVolumeBootPattern-1064630590 tempest-TestVolumeBootPattern-1064630590-project] Getting quotas for project 305e3a203e4f4a6587868d912011ea19. Resources: {'cores', 'ram', 'instances'} {{(pid=98843) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 14:12:11.689168 n-d-791503-6 nova-conductor[98843]: DEBUG nova.quota [None req-71a8813a-4736-4157-8d59-605521f67c0f tempest-TestVolumeBootPattern-1064630590 tempest-TestVolumeBootPattern-1064630590-project] Getting quotas for user 4369165fbbb64bb194d32c8ca9624ca3 and project 305e3a203e4f4a6587868d912011ea19. Resources: {'cores', 'ram', 'instances'} {{(pid=98843) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 14:12:11.713544 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-71a8813a-4736-4157-8d59-605521f67c0f tempest-TestVolumeBootPattern-1064630590 tempest-TestVolumeBootPattern-1064630590-project] [instance: 73a1dd28-c4a7-4a2c-b6b7-8695ac9e9bbe] Selected host: n-h1-791503-6; Selected node: n-h1-791503-6; Alternates: [('n-h2-791503-6', 'n-h2-791503-6')] {{(pid=98843) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 14:12:11.721288 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-71a8813a-4736-4157-8d59-605521f67c0f tempest-TestVolumeBootPattern-1064630590 tempest-TestVolumeBootPattern-1064630590-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:12:11.721984 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-71a8813a-4736-4157-8d59-605521f67c0f tempest-TestVolumeBootPattern-1064630590 tempest-TestVolumeBootPattern-1064630590-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:12:11.740753 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-71a8813a-4736-4157-8d59-605521f67c0f tempest-TestVolumeBootPattern-1064630590 tempest-TestVolumeBootPattern-1064630590-project] [instance: 73a1dd28-c4a7-4a2c-b6b7-8695ac9e9bbe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='160baac3-ea21-4590-8856-99c7cc38e5c8',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=98843) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 14:12:11.744150 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-71a8813a-4736-4157-8d59-605521f67c0f tempest-TestVolumeBootPattern-1064630590 tempest-TestVolumeBootPattern-1064630590-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:12:11.744998 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-71a8813a-4736-4157-8d59-605521f67c0f tempest-TestVolumeBootPattern-1064630590 tempest-TestVolumeBootPattern-1064630590-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:12:11.838563 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-71a8813a-4736-4157-8d59-605521f67c0f tempest-TestVolumeBootPattern-1064630590 tempest-TestVolumeBootPattern-1064630590-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:12:11.839492 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-71a8813a-4736-4157-8d59-605521f67c0f tempest-TestVolumeBootPattern-1064630590 tempest-TestVolumeBootPattern-1064630590-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:12:28.270548 n-d-791503-6 nova-conductor[98843]: ERROR oslo.messaging._drivers.impl_rabbit [-] [fb67aa64-250d-4c34-b696-14a5dd0b49b6] AMQP server on 10.222.0.68:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection May 28 14:12:29.362465 n-d-791503-6 nova-conductor[98843]: INFO oslo.messaging._drivers.impl_rabbit [-] [fb67aa64-250d-4c34-b696-14a5dd0b49b6] Reconnected to AMQP server on 10.222.0.68:5672 via [amqp] client with port 35914. May 28 14:13:25.896315 n-d-791503-6 nova-conductor[98844]: ERROR oslo.messaging._drivers.impl_rabbit [-] [8840711a-c4c2-4555-9645-ce157ee9cc0d] AMQP server on 10.222.0.68:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 28 14:13:26.956464 n-d-791503-6 nova-conductor[98844]: INFO oslo.messaging._drivers.impl_rabbit [-] [8840711a-c4c2-4555-9645-ce157ee9cc0d] Reconnected to AMQP server on 10.222.0.68:5672 via [amqp] client with port 36796. May 28 14:13:30.280865 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-23d29f51-76e9-4aa2-8fa0-a1e924d9735f tempest-VolumesSnapshotTestJSON-2119717970 tempest-VolumesSnapshotTestJSON-2119717970-project] Took 1.49 seconds to select destinations for 1 instance(s). {{(pid=98843) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 14:13:30.359130 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-23d29f51-76e9-4aa2-8fa0-a1e924d9735f tempest-VolumesSnapshotTestJSON-2119717970 tempest-VolumesSnapshotTestJSON-2119717970-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:13:30.362061 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-23d29f51-76e9-4aa2-8fa0-a1e924d9735f tempest-VolumesSnapshotTestJSON-2119717970 tempest-VolumesSnapshotTestJSON-2119717970-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:13:30.501160 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-23d29f51-76e9-4aa2-8fa0-a1e924d9735f tempest-VolumesSnapshotTestJSON-2119717970 tempest-VolumesSnapshotTestJSON-2119717970-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:13:30.502059 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-23d29f51-76e9-4aa2-8fa0-a1e924d9735f tempest-VolumesSnapshotTestJSON-2119717970 tempest-VolumesSnapshotTestJSON-2119717970-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:13:30.503382 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-23d29f51-76e9-4aa2-8fa0-a1e924d9735f tempest-VolumesSnapshotTestJSON-2119717970 tempest-VolumesSnapshotTestJSON-2119717970-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:13:30.504162 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-23d29f51-76e9-4aa2-8fa0-a1e924d9735f tempest-VolumesSnapshotTestJSON-2119717970 tempest-VolumesSnapshotTestJSON-2119717970-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:13:30.536381 n-d-791503-6 nova-conductor[98843]: DEBUG nova.quota [None req-23d29f51-76e9-4aa2-8fa0-a1e924d9735f tempest-VolumesSnapshotTestJSON-2119717970 tempest-VolumesSnapshotTestJSON-2119717970-project] Getting quotas for project e1e6f8a560b44d59b5583634db7a7836. Resources: {'cores', 'ram', 'instances'} {{(pid=98843) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 14:13:30.545677 n-d-791503-6 nova-conductor[98843]: DEBUG nova.quota [None req-23d29f51-76e9-4aa2-8fa0-a1e924d9735f tempest-VolumesSnapshotTestJSON-2119717970 tempest-VolumesSnapshotTestJSON-2119717970-project] Getting quotas for user 26f727d25dba43dfbbf0d016e8c7970a and project e1e6f8a560b44d59b5583634db7a7836. Resources: {'cores', 'ram', 'instances'} {{(pid=98843) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 14:13:30.566895 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-23d29f51-76e9-4aa2-8fa0-a1e924d9735f tempest-VolumesSnapshotTestJSON-2119717970 tempest-VolumesSnapshotTestJSON-2119717970-project] [instance: a4929d1f-e0fd-4749-9aaa-e4adaac59271] Selected host: n-h2-791503-6; Selected node: n-h2-791503-6; Alternates: [('n-h1-791503-6', 'n-h1-791503-6')] {{(pid=98843) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 14:13:30.568752 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-23d29f51-76e9-4aa2-8fa0-a1e924d9735f tempest-VolumesSnapshotTestJSON-2119717970 tempest-VolumesSnapshotTestJSON-2119717970-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:13:30.569597 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-23d29f51-76e9-4aa2-8fa0-a1e924d9735f tempest-VolumesSnapshotTestJSON-2119717970 tempest-VolumesSnapshotTestJSON-2119717970-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:13:30.590346 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-23d29f51-76e9-4aa2-8fa0-a1e924d9735f tempest-VolumesSnapshotTestJSON-2119717970 tempest-VolumesSnapshotTestJSON-2119717970-project] [instance: a4929d1f-e0fd-4749-9aaa-e4adaac59271] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='64f6036b-99a9-40e4-8963-3cdf66964954',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98843) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 14:13:30.601325 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-23d29f51-76e9-4aa2-8fa0-a1e924d9735f tempest-VolumesSnapshotTestJSON-2119717970 tempest-VolumesSnapshotTestJSON-2119717970-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:13:30.601932 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-23d29f51-76e9-4aa2-8fa0-a1e924d9735f tempest-VolumesSnapshotTestJSON-2119717970 tempest-VolumesSnapshotTestJSON-2119717970-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:13:30.728871 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-23d29f51-76e9-4aa2-8fa0-a1e924d9735f tempest-VolumesSnapshotTestJSON-2119717970 tempest-VolumesSnapshotTestJSON-2119717970-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:13:30.730798 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-23d29f51-76e9-4aa2-8fa0-a1e924d9735f tempest-VolumesSnapshotTestJSON-2119717970 tempest-VolumesSnapshotTestJSON-2119717970-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:13:45.098433 n-d-791503-6 nova-conductor[98844]: ERROR oslo.messaging._drivers.impl_rabbit [-] [abccac45-5c00-4182-bcd1-fb6828b957ad] AMQP server on 10.222.0.68:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 28 14:13:46.148637 n-d-791503-6 nova-conductor[98844]: INFO oslo.messaging._drivers.impl_rabbit [-] [abccac45-5c00-4182-bcd1-fb6828b957ad] Reconnected to AMQP server on 10.222.0.68:5672 via [amqp] client with port 37100. May 28 14:14:05.182475 n-d-791503-6 nova-conductor[98844]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 14:14:07.749909 n-d-791503-6 nova-conductor[98844]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 14:14:28.066375 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.manager [None req-b87b3ee8-9018-4396-b621-400cf63b1720 tempest-TestVolumeBootPattern-1064630590 tempest-TestVolumeBootPattern-1064630590-project] Took 0.52 seconds to select destinations for 1 instance(s). {{(pid=98844) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 14:14:28.108691 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-b87b3ee8-9018-4396-b621-400cf63b1720 tempest-TestVolumeBootPattern-1064630590 tempest-TestVolumeBootPattern-1064630590-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:14:28.109340 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-b87b3ee8-9018-4396-b621-400cf63b1720 tempest-TestVolumeBootPattern-1064630590 tempest-TestVolumeBootPattern-1064630590-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:14:28.251513 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-b87b3ee8-9018-4396-b621-400cf63b1720 tempest-TestVolumeBootPattern-1064630590 tempest-TestVolumeBootPattern-1064630590-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:14:28.252091 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-b87b3ee8-9018-4396-b621-400cf63b1720 tempest-TestVolumeBootPattern-1064630590 tempest-TestVolumeBootPattern-1064630590-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:14:28.253510 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-b87b3ee8-9018-4396-b621-400cf63b1720 tempest-TestVolumeBootPattern-1064630590 tempest-TestVolumeBootPattern-1064630590-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:14:28.254390 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-b87b3ee8-9018-4396-b621-400cf63b1720 tempest-TestVolumeBootPattern-1064630590 tempest-TestVolumeBootPattern-1064630590-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:14:28.292297 n-d-791503-6 nova-conductor[98844]: DEBUG nova.quota [None req-b87b3ee8-9018-4396-b621-400cf63b1720 tempest-TestVolumeBootPattern-1064630590 tempest-TestVolumeBootPattern-1064630590-project] Getting quotas for project 305e3a203e4f4a6587868d912011ea19. Resources: {'cores', 'ram', 'instances'} {{(pid=98844) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 14:14:28.311291 n-d-791503-6 nova-conductor[98844]: DEBUG nova.quota [None req-b87b3ee8-9018-4396-b621-400cf63b1720 tempest-TestVolumeBootPattern-1064630590 tempest-TestVolumeBootPattern-1064630590-project] Getting quotas for user 4369165fbbb64bb194d32c8ca9624ca3 and project 305e3a203e4f4a6587868d912011ea19. Resources: {'cores', 'ram', 'instances'} {{(pid=98844) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 14:14:28.345039 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.manager [None req-b87b3ee8-9018-4396-b621-400cf63b1720 tempest-TestVolumeBootPattern-1064630590 tempest-TestVolumeBootPattern-1064630590-project] [instance: 77eb0b2d-fb3a-4144-bbf1-ea6708379609] Selected host: n-h1-791503-6; Selected node: n-h1-791503-6; Alternates: [('n-h2-791503-6', 'n-h2-791503-6')] {{(pid=98844) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 14:14:28.346974 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-b87b3ee8-9018-4396-b621-400cf63b1720 tempest-TestVolumeBootPattern-1064630590 tempest-TestVolumeBootPattern-1064630590-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:14:28.347950 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-b87b3ee8-9018-4396-b621-400cf63b1720 tempest-TestVolumeBootPattern-1064630590 tempest-TestVolumeBootPattern-1064630590-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:14:28.379248 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.manager [None req-b87b3ee8-9018-4396-b621-400cf63b1720 tempest-TestVolumeBootPattern-1064630590 tempest-TestVolumeBootPattern-1064630590-project] [instance: 77eb0b2d-fb3a-4144-bbf1-ea6708379609] block_device_mapping [BlockDeviceMapping(attachment_id=8d86166e-113c-4ef2-a66b-0f396c366539,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e269b742-54a6-401a-9f10-b1da22d4bc15',volume_size=1,volume_type=None)] {{(pid=98844) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 14:14:28.382008 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-b87b3ee8-9018-4396-b621-400cf63b1720 tempest-TestVolumeBootPattern-1064630590 tempest-TestVolumeBootPattern-1064630590-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:14:28.382888 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-b87b3ee8-9018-4396-b621-400cf63b1720 tempest-TestVolumeBootPattern-1064630590 tempest-TestVolumeBootPattern-1064630590-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:14:28.477601 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-b87b3ee8-9018-4396-b621-400cf63b1720 tempest-TestVolumeBootPattern-1064630590 tempest-TestVolumeBootPattern-1064630590-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:14:28.478575 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-b87b3ee8-9018-4396-b621-400cf63b1720 tempest-TestVolumeBootPattern-1064630590 tempest-TestVolumeBootPattern-1064630590-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:14:37.795775 n-d-791503-6 nova-conductor[98844]: ERROR oslo.messaging._drivers.impl_rabbit [-] [cbd7c90c-b59a-4f8b-992f-d04ba5ad6f9c] AMQP server on 10.222.0.68:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection May 28 14:14:38.989114 n-d-791503-6 nova-conductor[98844]: INFO oslo.messaging._drivers.impl_rabbit [-] [cbd7c90c-b59a-4f8b-992f-d04ba5ad6f9c] Reconnected to AMQP server on 10.222.0.68:5672 via [amqp] client with port 38522. May 28 14:14:45.437567 n-d-791503-6 nova-conductor[98843]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 14:15:10.584552 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-e207cbe5-ac2b-49ad-88b4-dc1ca98b996e tempest-TestVolumeBootPattern-1064630590 tempest-TestVolumeBootPattern-1064630590-project] Took 0.54 seconds to select destinations for 1 instance(s). {{(pid=98843) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 14:15:10.695521 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-e207cbe5-ac2b-49ad-88b4-dc1ca98b996e tempest-TestVolumeBootPattern-1064630590 tempest-TestVolumeBootPattern-1064630590-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:15:10.699519 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-e207cbe5-ac2b-49ad-88b4-dc1ca98b996e tempest-TestVolumeBootPattern-1064630590 tempest-TestVolumeBootPattern-1064630590-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:15:10.926124 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-e207cbe5-ac2b-49ad-88b4-dc1ca98b996e tempest-TestVolumeBootPattern-1064630590 tempest-TestVolumeBootPattern-1064630590-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:15:10.927436 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-e207cbe5-ac2b-49ad-88b4-dc1ca98b996e tempest-TestVolumeBootPattern-1064630590 tempest-TestVolumeBootPattern-1064630590-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:15:10.928948 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-e207cbe5-ac2b-49ad-88b4-dc1ca98b996e tempest-TestVolumeBootPattern-1064630590 tempest-TestVolumeBootPattern-1064630590-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:15:10.930199 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-e207cbe5-ac2b-49ad-88b4-dc1ca98b996e tempest-TestVolumeBootPattern-1064630590 tempest-TestVolumeBootPattern-1064630590-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:15:10.988827 n-d-791503-6 nova-conductor[98843]: DEBUG nova.quota [None req-e207cbe5-ac2b-49ad-88b4-dc1ca98b996e tempest-TestVolumeBootPattern-1064630590 tempest-TestVolumeBootPattern-1064630590-project] Getting quotas for project 305e3a203e4f4a6587868d912011ea19. Resources: {'cores', 'ram', 'instances'} {{(pid=98843) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 14:15:11.021748 n-d-791503-6 nova-conductor[98843]: DEBUG nova.quota [None req-e207cbe5-ac2b-49ad-88b4-dc1ca98b996e tempest-TestVolumeBootPattern-1064630590 tempest-TestVolumeBootPattern-1064630590-project] Getting quotas for user 4369165fbbb64bb194d32c8ca9624ca3 and project 305e3a203e4f4a6587868d912011ea19. Resources: {'cores', 'ram', 'instances'} {{(pid=98843) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 14:15:11.087787 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-e207cbe5-ac2b-49ad-88b4-dc1ca98b996e tempest-TestVolumeBootPattern-1064630590 tempest-TestVolumeBootPattern-1064630590-project] [instance: 8cb794c2-01fa-4a79-946d-d415d1abf0ba] Selected host: n-h1-791503-6; Selected node: n-h1-791503-6; Alternates: [('n-h2-791503-6', 'n-h2-791503-6')] {{(pid=98843) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 14:15:11.089473 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-e207cbe5-ac2b-49ad-88b4-dc1ca98b996e tempest-TestVolumeBootPattern-1064630590 tempest-TestVolumeBootPattern-1064630590-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:15:11.093734 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-e207cbe5-ac2b-49ad-88b4-dc1ca98b996e tempest-TestVolumeBootPattern-1064630590 tempest-TestVolumeBootPattern-1064630590-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:15:11.123493 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-e207cbe5-ac2b-49ad-88b4-dc1ca98b996e tempest-TestVolumeBootPattern-1064630590 tempest-TestVolumeBootPattern-1064630590-project] [instance: 8cb794c2-01fa-4a79-946d-d415d1abf0ba] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name='/dev/sda',device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='d5b6eaa6-708f-41a0-bf22-78b92d283443',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=98843) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 14:15:11.125923 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-e207cbe5-ac2b-49ad-88b4-dc1ca98b996e tempest-TestVolumeBootPattern-1064630590 tempest-TestVolumeBootPattern-1064630590-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:15:11.127034 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-e207cbe5-ac2b-49ad-88b4-dc1ca98b996e tempest-TestVolumeBootPattern-1064630590 tempest-TestVolumeBootPattern-1064630590-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:15:11.249866 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-e207cbe5-ac2b-49ad-88b4-dc1ca98b996e tempest-TestVolumeBootPattern-1064630590 tempest-TestVolumeBootPattern-1064630590-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:15:11.250355 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-e207cbe5-ac2b-49ad-88b4-dc1ca98b996e tempest-TestVolumeBootPattern-1064630590 tempest-TestVolumeBootPattern-1064630590-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:15:16.126001 n-d-791503-6 nova-conductor[98844]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 14:15:29.350359 n-d-791503-6 nova-conductor[98843]: ERROR oslo.messaging._drivers.impl_rabbit [-] [fb67aa64-250d-4c34-b696-14a5dd0b49b6] AMQP server on 10.222.0.68:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection May 28 14:15:30.442942 n-d-791503-6 nova-conductor[98843]: INFO oslo.messaging._drivers.impl_rabbit [-] [fb67aa64-250d-4c34-b696-14a5dd0b49b6] Reconnected to AMQP server on 10.222.0.68:5672 via [amqp] client with port 39538. May 28 14:15:40.059594 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.manager [None req-11b9654a-1661-47b0-952d-772abc94fe67 tempest-TestNetworkAdvancedServerOps-325372242 tempest-TestNetworkAdvancedServerOps-325372242-project] Took 0.68 seconds to select destinations for 1 instance(s). {{(pid=98844) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 14:15:40.144181 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-11b9654a-1661-47b0-952d-772abc94fe67 tempest-TestNetworkAdvancedServerOps-325372242 tempest-TestNetworkAdvancedServerOps-325372242-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:15:40.144511 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-11b9654a-1661-47b0-952d-772abc94fe67 tempest-TestNetworkAdvancedServerOps-325372242 tempest-TestNetworkAdvancedServerOps-325372242-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:15:40.254992 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-11b9654a-1661-47b0-952d-772abc94fe67 tempest-TestNetworkAdvancedServerOps-325372242 tempest-TestNetworkAdvancedServerOps-325372242-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:15:40.255884 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-11b9654a-1661-47b0-952d-772abc94fe67 tempest-TestNetworkAdvancedServerOps-325372242 tempest-TestNetworkAdvancedServerOps-325372242-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:15:40.257274 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-11b9654a-1661-47b0-952d-772abc94fe67 tempest-TestNetworkAdvancedServerOps-325372242 tempest-TestNetworkAdvancedServerOps-325372242-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:15:40.258061 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-11b9654a-1661-47b0-952d-772abc94fe67 tempest-TestNetworkAdvancedServerOps-325372242 tempest-TestNetworkAdvancedServerOps-325372242-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:15:40.285000 n-d-791503-6 nova-conductor[98844]: DEBUG nova.quota [None req-11b9654a-1661-47b0-952d-772abc94fe67 tempest-TestNetworkAdvancedServerOps-325372242 tempest-TestNetworkAdvancedServerOps-325372242-project] Getting quotas for project 2a60bb13a0574cdab82008527834da62. Resources: {'cores', 'ram', 'instances'} {{(pid=98844) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 14:15:40.298234 n-d-791503-6 nova-conductor[98844]: DEBUG nova.quota [None req-11b9654a-1661-47b0-952d-772abc94fe67 tempest-TestNetworkAdvancedServerOps-325372242 tempest-TestNetworkAdvancedServerOps-325372242-project] Getting quotas for user 0c0e5ad3040d4b359c87144f5f35b3e3 and project 2a60bb13a0574cdab82008527834da62. Resources: {'cores', 'ram', 'instances'} {{(pid=98844) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 14:15:40.333601 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.manager [None req-11b9654a-1661-47b0-952d-772abc94fe67 tempest-TestNetworkAdvancedServerOps-325372242 tempest-TestNetworkAdvancedServerOps-325372242-project] [instance: 017aee01-f8e6-440d-bbc7-c094d4a64fc1] Selected host: n-h2-791503-6; Selected node: n-h2-791503-6; Alternates: [('n-h1-791503-6', 'n-h1-791503-6')] {{(pid=98844) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 14:15:40.337097 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-11b9654a-1661-47b0-952d-772abc94fe67 tempest-TestNetworkAdvancedServerOps-325372242 tempest-TestNetworkAdvancedServerOps-325372242-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:15:40.340584 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-11b9654a-1661-47b0-952d-772abc94fe67 tempest-TestNetworkAdvancedServerOps-325372242 tempest-TestNetworkAdvancedServerOps-325372242-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:15:40.361698 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.manager [None req-11b9654a-1661-47b0-952d-772abc94fe67 tempest-TestNetworkAdvancedServerOps-325372242 tempest-TestNetworkAdvancedServerOps-325372242-project] [instance: 017aee01-f8e6-440d-bbc7-c094d4a64fc1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='64f6036b-99a9-40e4-8963-3cdf66964954',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98844) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 14:15:40.363670 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-11b9654a-1661-47b0-952d-772abc94fe67 tempest-TestNetworkAdvancedServerOps-325372242 tempest-TestNetworkAdvancedServerOps-325372242-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:15:40.364376 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-11b9654a-1661-47b0-952d-772abc94fe67 tempest-TestNetworkAdvancedServerOps-325372242 tempest-TestNetworkAdvancedServerOps-325372242-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:15:40.431842 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-11b9654a-1661-47b0-952d-772abc94fe67 tempest-TestNetworkAdvancedServerOps-325372242 tempest-TestNetworkAdvancedServerOps-325372242-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:15:40.433821 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-11b9654a-1661-47b0-952d-772abc94fe67 tempest-TestNetworkAdvancedServerOps-325372242 tempest-TestNetworkAdvancedServerOps-325372242-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:16:41.737511 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-d8e40c11-1bd5-4354-a566-242dab5d8039 tempest-TestNetworkAdvancedServerOps-360935568 tempest-TestNetworkAdvancedServerOps-360935568-project-admin] Targeting cell b241212c-c279-4fbb-a1e7-b87889287cbf(cell1) for conductor method migrate_server {{(pid=98843) wrapper /opt/stack/nova/nova/conductor/manager.py:91}} May 28 14:16:41.743907 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-d8e40c11-1bd5-4354-a566-242dab5d8039 tempest-TestNetworkAdvancedServerOps-360935568 tempest-TestNetworkAdvancedServerOps-360935568-project-admin] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:16:41.746448 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-d8e40c11-1bd5-4354-a566-242dab5d8039 tempest-TestNetworkAdvancedServerOps-360935568 tempest-TestNetworkAdvancedServerOps-360935568-project-admin] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:16:42.875735 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.tasks.migrate [None req-d8e40c11-1bd5-4354-a566-242dab5d8039 tempest-TestNetworkAdvancedServerOps-360935568 tempest-TestNetworkAdvancedServerOps-360935568-project-admin] [instance: 017aee01-f8e6-440d-bbc7-c094d4a64fc1] Restricting to cell b241212c-c279-4fbb-a1e7-b87889287cbf(cell1) while migrating {{(pid=98843) _set_requested_destination_cell /opt/stack/nova/nova/conductor/tasks/migrate.py:208}} May 28 14:16:43.990563 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.tasks.migrate [None req-d8e40c11-1bd5-4354-a566-242dab5d8039 tempest-TestNetworkAdvancedServerOps-360935568 tempest-TestNetworkAdvancedServerOps-360935568-project-admin] Created allocations for migration 3b3b2dee-bfef-47fe-a251-80a1557f3536 on 5c5ac110-743a-4b71-a058-d2597ba8e0c9 {{(pid=98843) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} May 28 14:16:44.796347 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.tasks.migrate [None req-d8e40c11-1bd5-4354-a566-242dab5d8039 tempest-TestNetworkAdvancedServerOps-360935568 tempest-TestNetworkAdvancedServerOps-360935568-project-admin] [instance: 017aee01-f8e6-440d-bbc7-c094d4a64fc1] Calling prep_resize with selected host: n-h1-791503-6; Selected node: n-h1-791503-6; Alternates: [] {{(pid=98843) _execute /opt/stack/nova/nova/conductor/tasks/migrate.py:315}} May 28 14:17:19.887369 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.manager [None req-b090d531-6a9d-4ed3-9740-1f2e3c1273c1 tempest-VolumesActionsTest-24896141 tempest-VolumesActionsTest-24896141-project] Took 0.70 seconds to select destinations for 1 instance(s). {{(pid=98844) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 14:17:19.939378 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-b090d531-6a9d-4ed3-9740-1f2e3c1273c1 tempest-VolumesActionsTest-24896141 tempest-VolumesActionsTest-24896141-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:17:19.939949 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-b090d531-6a9d-4ed3-9740-1f2e3c1273c1 tempest-VolumesActionsTest-24896141 tempest-VolumesActionsTest-24896141-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:17:20.083036 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-b090d531-6a9d-4ed3-9740-1f2e3c1273c1 tempest-VolumesActionsTest-24896141 tempest-VolumesActionsTest-24896141-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:17:20.084754 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-b090d531-6a9d-4ed3-9740-1f2e3c1273c1 tempest-VolumesActionsTest-24896141 tempest-VolumesActionsTest-24896141-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:17:20.088319 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-b090d531-6a9d-4ed3-9740-1f2e3c1273c1 tempest-VolumesActionsTest-24896141 tempest-VolumesActionsTest-24896141-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:17:20.089578 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-b090d531-6a9d-4ed3-9740-1f2e3c1273c1 tempest-VolumesActionsTest-24896141 tempest-VolumesActionsTest-24896141-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:17:20.153186 n-d-791503-6 nova-conductor[98844]: DEBUG nova.quota [None req-b090d531-6a9d-4ed3-9740-1f2e3c1273c1 tempest-VolumesActionsTest-24896141 tempest-VolumesActionsTest-24896141-project] Getting quotas for project 2fd80fb931114e7fa0dc4f3c47cbcfa9. Resources: {'cores', 'ram', 'instances'} {{(pid=98844) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 14:17:20.171105 n-d-791503-6 nova-conductor[98844]: DEBUG nova.quota [None req-b090d531-6a9d-4ed3-9740-1f2e3c1273c1 tempest-VolumesActionsTest-24896141 tempest-VolumesActionsTest-24896141-project] Getting quotas for user d37b111bc9e84024a91ca690d342f136 and project 2fd80fb931114e7fa0dc4f3c47cbcfa9. Resources: {'cores', 'ram', 'instances'} {{(pid=98844) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 14:17:20.207272 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.manager [None req-b090d531-6a9d-4ed3-9740-1f2e3c1273c1 tempest-VolumesActionsTest-24896141 tempest-VolumesActionsTest-24896141-project] [instance: 8f323866-0cd0-4727-8eb9-fd2d13f4f35c] Selected host: n-h1-791503-6; Selected node: n-h1-791503-6; Alternates: [('n-h2-791503-6', 'n-h2-791503-6')] {{(pid=98844) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 14:17:20.212760 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-b090d531-6a9d-4ed3-9740-1f2e3c1273c1 tempest-VolumesActionsTest-24896141 tempest-VolumesActionsTest-24896141-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:17:20.222036 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-b090d531-6a9d-4ed3-9740-1f2e3c1273c1 tempest-VolumesActionsTest-24896141 tempest-VolumesActionsTest-24896141-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:17:20.238709 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.manager [None req-b090d531-6a9d-4ed3-9740-1f2e3c1273c1 tempest-VolumesActionsTest-24896141 tempest-VolumesActionsTest-24896141-project] [instance: 8f323866-0cd0-4727-8eb9-fd2d13f4f35c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='64f6036b-99a9-40e4-8963-3cdf66964954',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98844) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 14:17:20.241647 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-b090d531-6a9d-4ed3-9740-1f2e3c1273c1 tempest-VolumesActionsTest-24896141 tempest-VolumesActionsTest-24896141-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:17:20.242656 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-b090d531-6a9d-4ed3-9740-1f2e3c1273c1 tempest-VolumesActionsTest-24896141 tempest-VolumesActionsTest-24896141-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:17:20.337785 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-b090d531-6a9d-4ed3-9740-1f2e3c1273c1 tempest-VolumesActionsTest-24896141 tempest-VolumesActionsTest-24896141-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:17:20.338925 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-b090d531-6a9d-4ed3-9740-1f2e3c1273c1 tempest-VolumesActionsTest-24896141 tempest-VolumesActionsTest-24896141-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:17:38.989653 n-d-791503-6 nova-conductor[98844]: ERROR oslo.messaging._drivers.impl_rabbit [-] [cbd7c90c-b59a-4f8b-992f-d04ba5ad6f9c] AMQP server on 10.222.0.68:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 28 14:17:40.016568 n-d-791503-6 nova-conductor[98844]: INFO oslo.messaging._drivers.impl_rabbit [-] [cbd7c90c-b59a-4f8b-992f-d04ba5ad6f9c] Reconnected to AMQP server on 10.222.0.68:5672 via [amqp] client with port 41398. May 28 14:17:40.667874 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-473a36ca-7ea0-45eb-a783-a5584c95b5df tempest-TestVolumeBootPattern-1064630590 tempest-TestVolumeBootPattern-1064630590-project] Took 0.35 seconds to select destinations for 1 instance(s). {{(pid=98843) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 14:17:40.692594 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-473a36ca-7ea0-45eb-a783-a5584c95b5df tempest-TestVolumeBootPattern-1064630590 tempest-TestVolumeBootPattern-1064630590-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:17:40.693001 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-473a36ca-7ea0-45eb-a783-a5584c95b5df tempest-TestVolumeBootPattern-1064630590 tempest-TestVolumeBootPattern-1064630590-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:17:40.766681 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-473a36ca-7ea0-45eb-a783-a5584c95b5df tempest-TestVolumeBootPattern-1064630590 tempest-TestVolumeBootPattern-1064630590-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:17:40.767361 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-473a36ca-7ea0-45eb-a783-a5584c95b5df tempest-TestVolumeBootPattern-1064630590 tempest-TestVolumeBootPattern-1064630590-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:17:40.768310 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-473a36ca-7ea0-45eb-a783-a5584c95b5df tempest-TestVolumeBootPattern-1064630590 tempest-TestVolumeBootPattern-1064630590-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:17:40.768739 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-473a36ca-7ea0-45eb-a783-a5584c95b5df tempest-TestVolumeBootPattern-1064630590 tempest-TestVolumeBootPattern-1064630590-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:17:40.790612 n-d-791503-6 nova-conductor[98843]: DEBUG nova.quota [None req-473a36ca-7ea0-45eb-a783-a5584c95b5df tempest-TestVolumeBootPattern-1064630590 tempest-TestVolumeBootPattern-1064630590-project] Getting quotas for project 305e3a203e4f4a6587868d912011ea19. Resources: {'cores', 'ram', 'instances'} {{(pid=98843) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 14:17:40.797364 n-d-791503-6 nova-conductor[98843]: DEBUG nova.quota [None req-473a36ca-7ea0-45eb-a783-a5584c95b5df tempest-TestVolumeBootPattern-1064630590 tempest-TestVolumeBootPattern-1064630590-project] Getting quotas for user 4369165fbbb64bb194d32c8ca9624ca3 and project 305e3a203e4f4a6587868d912011ea19. Resources: {'cores', 'ram', 'instances'} {{(pid=98843) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 14:17:40.811353 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-473a36ca-7ea0-45eb-a783-a5584c95b5df tempest-TestVolumeBootPattern-1064630590 tempest-TestVolumeBootPattern-1064630590-project] [instance: 853a8f0a-ec3e-46fb-97e3-795d248bf043] Selected host: n-h2-791503-6; Selected node: n-h2-791503-6; Alternates: [('n-h1-791503-6', 'n-h1-791503-6')] {{(pid=98843) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 14:17:40.813218 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-473a36ca-7ea0-45eb-a783-a5584c95b5df tempest-TestVolumeBootPattern-1064630590 tempest-TestVolumeBootPattern-1064630590-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:17:40.813811 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-473a36ca-7ea0-45eb-a783-a5584c95b5df tempest-TestVolumeBootPattern-1064630590 tempest-TestVolumeBootPattern-1064630590-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:17:40.822761 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-473a36ca-7ea0-45eb-a783-a5584c95b5df tempest-TestVolumeBootPattern-1064630590 tempest-TestVolumeBootPattern-1064630590-project] [instance: 853a8f0a-ec3e-46fb-97e3-795d248bf043] block_device_mapping [BlockDeviceMapping(attachment_id=137603a3-feb3-4799-a9fd-507153adb6ed,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='eb7b0e13-e618-4f40-87bb-3fa465fe5a4d',volume_size=1,volume_type=None)] {{(pid=98843) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 14:17:40.824994 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-473a36ca-7ea0-45eb-a783-a5584c95b5df tempest-TestVolumeBootPattern-1064630590 tempest-TestVolumeBootPattern-1064630590-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:17:40.825709 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-473a36ca-7ea0-45eb-a783-a5584c95b5df tempest-TestVolumeBootPattern-1064630590 tempest-TestVolumeBootPattern-1064630590-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:17:40.886932 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-473a36ca-7ea0-45eb-a783-a5584c95b5df tempest-TestVolumeBootPattern-1064630590 tempest-TestVolumeBootPattern-1064630590-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:17:40.887848 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-473a36ca-7ea0-45eb-a783-a5584c95b5df tempest-TestVolumeBootPattern-1064630590 tempest-TestVolumeBootPattern-1064630590-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:18:00.700088 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.manager [None req-f05017b5-510e-49e4-8638-6c9d201150bc tempest-VolumesActionsTest-24896141 tempest-VolumesActionsTest-24896141-project] Took 0.35 seconds to select destinations for 1 instance(s). {{(pid=98844) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 14:18:00.726231 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-f05017b5-510e-49e4-8638-6c9d201150bc tempest-VolumesActionsTest-24896141 tempest-VolumesActionsTest-24896141-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:18:00.726584 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-f05017b5-510e-49e4-8638-6c9d201150bc tempest-VolumesActionsTest-24896141 tempest-VolumesActionsTest-24896141-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:18:00.817078 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-f05017b5-510e-49e4-8638-6c9d201150bc tempest-VolumesActionsTest-24896141 tempest-VolumesActionsTest-24896141-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:18:00.818326 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-f05017b5-510e-49e4-8638-6c9d201150bc tempest-VolumesActionsTest-24896141 tempest-VolumesActionsTest-24896141-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:18:00.820553 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-f05017b5-510e-49e4-8638-6c9d201150bc tempest-VolumesActionsTest-24896141 tempest-VolumesActionsTest-24896141-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:18:00.824436 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-f05017b5-510e-49e4-8638-6c9d201150bc tempest-VolumesActionsTest-24896141 tempest-VolumesActionsTest-24896141-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:18:00.862748 n-d-791503-6 nova-conductor[98844]: DEBUG nova.quota [None req-f05017b5-510e-49e4-8638-6c9d201150bc tempest-VolumesActionsTest-24896141 tempest-VolumesActionsTest-24896141-project] Getting quotas for project 2fd80fb931114e7fa0dc4f3c47cbcfa9. Resources: {'cores', 'ram', 'instances'} {{(pid=98844) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 14:18:00.872267 n-d-791503-6 nova-conductor[98844]: DEBUG nova.quota [None req-f05017b5-510e-49e4-8638-6c9d201150bc tempest-VolumesActionsTest-24896141 tempest-VolumesActionsTest-24896141-project] Getting quotas for user d37b111bc9e84024a91ca690d342f136 and project 2fd80fb931114e7fa0dc4f3c47cbcfa9. Resources: {'cores', 'ram', 'instances'} {{(pid=98844) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 14:18:00.892836 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.manager [None req-f05017b5-510e-49e4-8638-6c9d201150bc tempest-VolumesActionsTest-24896141 tempest-VolumesActionsTest-24896141-project] [instance: 89e3022e-a1cb-404e-9f6c-63fc2c28c934] Selected host: n-h1-791503-6; Selected node: n-h1-791503-6; Alternates: [('n-h2-791503-6', 'n-h2-791503-6')] {{(pid=98844) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 14:18:00.894666 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-f05017b5-510e-49e4-8638-6c9d201150bc tempest-VolumesActionsTest-24896141 tempest-VolumesActionsTest-24896141-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:18:00.895414 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-f05017b5-510e-49e4-8638-6c9d201150bc tempest-VolumesActionsTest-24896141 tempest-VolumesActionsTest-24896141-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:18:00.928529 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.manager [None req-f05017b5-510e-49e4-8638-6c9d201150bc tempest-VolumesActionsTest-24896141 tempest-VolumesActionsTest-24896141-project] [instance: 89e3022e-a1cb-404e-9f6c-63fc2c28c934] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='64f6036b-99a9-40e4-8963-3cdf66964954',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98844) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 14:18:00.931620 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-f05017b5-510e-49e4-8638-6c9d201150bc tempest-VolumesActionsTest-24896141 tempest-VolumesActionsTest-24896141-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:18:00.932595 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-f05017b5-510e-49e4-8638-6c9d201150bc tempest-VolumesActionsTest-24896141 tempest-VolumesActionsTest-24896141-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:18:00.995711 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-f05017b5-510e-49e4-8638-6c9d201150bc tempest-VolumesActionsTest-24896141 tempest-VolumesActionsTest-24896141-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:18:00.999783 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-f05017b5-510e-49e4-8638-6c9d201150bc tempest-VolumesActionsTest-24896141 tempest-VolumesActionsTest-24896141-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:18:05.490208 n-d-791503-6 nova-conductor[98843]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 14:18:30.442772 n-d-791503-6 nova-conductor[98843]: ERROR oslo.messaging._drivers.impl_rabbit [-] [fb67aa64-250d-4c34-b696-14a5dd0b49b6] AMQP server on 10.222.0.68:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection May 28 14:18:31.468801 n-d-791503-6 nova-conductor[98843]: INFO oslo.messaging._drivers.impl_rabbit [-] [fb67aa64-250d-4c34-b696-14a5dd0b49b6] Reconnected to AMQP server on 10.222.0.68:5672 via [amqp] client with port 41962. May 28 14:18:36.173287 n-d-791503-6 nova-conductor[98844]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 14:19:46.401671 n-d-791503-6 nova-conductor[98843]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4bc4adbd-2091-473e-8e44-b9a43f01ab64] AMQP server on 10.222.0.68:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 28 14:19:47.439334 n-d-791503-6 nova-conductor[98843]: INFO oslo.messaging._drivers.impl_rabbit [-] [4bc4adbd-2091-473e-8e44-b9a43f01ab64] Reconnected to AMQP server on 10.222.0.68:5672 via [amqp] client with port 42922. May 28 14:20:15.764126 n-d-791503-6 nova-conductor[98843]: ERROR oslo.messaging._drivers.impl_rabbit [None req-25bbbfe3-b854-4bac-b699-ddcfca85b759 tempest-TestNetworkAdvancedServerOps-325372242 tempest-TestNetworkAdvancedServerOps-325372242-project] [bdcda531-d598-424e-8dcd-ab215e26c83b] AMQP server on 10.222.0.68:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 28 14:20:16.835160 n-d-791503-6 nova-conductor[98843]: INFO oslo.messaging._drivers.impl_rabbit [None req-25bbbfe3-b854-4bac-b699-ddcfca85b759 tempest-TestNetworkAdvancedServerOps-325372242 tempest-TestNetworkAdvancedServerOps-325372242-project] [bdcda531-d598-424e-8dcd-ab215e26c83b] Reconnected to AMQP server on 10.222.0.68:5672 via [amqp] client with port 43362. May 28 14:20:20.330513 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-25bbbfe3-b854-4bac-b699-ddcfca85b759 tempest-TestNetworkAdvancedServerOps-325372242 tempest-TestNetworkAdvancedServerOps-325372242-project] Took 4.59 seconds to select destinations for 1 instance(s). {{(pid=98843) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 14:20:20.403596 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-25bbbfe3-b854-4bac-b699-ddcfca85b759 tempest-TestNetworkAdvancedServerOps-325372242 tempest-TestNetworkAdvancedServerOps-325372242-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:20:20.404932 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-25bbbfe3-b854-4bac-b699-ddcfca85b759 tempest-TestNetworkAdvancedServerOps-325372242 tempest-TestNetworkAdvancedServerOps-325372242-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:20:20.490907 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-25bbbfe3-b854-4bac-b699-ddcfca85b759 tempest-TestNetworkAdvancedServerOps-325372242 tempest-TestNetworkAdvancedServerOps-325372242-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:20:20.491182 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-25bbbfe3-b854-4bac-b699-ddcfca85b759 tempest-TestNetworkAdvancedServerOps-325372242 tempest-TestNetworkAdvancedServerOps-325372242-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:20:20.492559 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-25bbbfe3-b854-4bac-b699-ddcfca85b759 tempest-TestNetworkAdvancedServerOps-325372242 tempest-TestNetworkAdvancedServerOps-325372242-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:20:20.493312 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-25bbbfe3-b854-4bac-b699-ddcfca85b759 tempest-TestNetworkAdvancedServerOps-325372242 tempest-TestNetworkAdvancedServerOps-325372242-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:20:20.540531 n-d-791503-6 nova-conductor[98843]: DEBUG nova.quota [None req-25bbbfe3-b854-4bac-b699-ddcfca85b759 tempest-TestNetworkAdvancedServerOps-325372242 tempest-TestNetworkAdvancedServerOps-325372242-project] Getting quotas for project 2a60bb13a0574cdab82008527834da62. Resources: {'cores', 'ram', 'instances'} {{(pid=98843) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 14:20:20.552671 n-d-791503-6 nova-conductor[98843]: DEBUG nova.quota [None req-25bbbfe3-b854-4bac-b699-ddcfca85b759 tempest-TestNetworkAdvancedServerOps-325372242 tempest-TestNetworkAdvancedServerOps-325372242-project] Getting quotas for user 0c0e5ad3040d4b359c87144f5f35b3e3 and project 2a60bb13a0574cdab82008527834da62. Resources: {'cores', 'ram', 'instances'} {{(pid=98843) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 14:20:20.584245 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-25bbbfe3-b854-4bac-b699-ddcfca85b759 tempest-TestNetworkAdvancedServerOps-325372242 tempest-TestNetworkAdvancedServerOps-325372242-project] [instance: c1f3f823-37b9-4b63-95b5-d97f2cc51f0d] Selected host: n-h1-791503-6; Selected node: n-h1-791503-6; Alternates: [('n-h2-791503-6', 'n-h2-791503-6')] {{(pid=98843) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 14:20:20.585608 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-25bbbfe3-b854-4bac-b699-ddcfca85b759 tempest-TestNetworkAdvancedServerOps-325372242 tempest-TestNetworkAdvancedServerOps-325372242-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:20:20.587094 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-25bbbfe3-b854-4bac-b699-ddcfca85b759 tempest-TestNetworkAdvancedServerOps-325372242 tempest-TestNetworkAdvancedServerOps-325372242-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:20:20.605690 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-25bbbfe3-b854-4bac-b699-ddcfca85b759 tempest-TestNetworkAdvancedServerOps-325372242 tempest-TestNetworkAdvancedServerOps-325372242-project] [instance: c1f3f823-37b9-4b63-95b5-d97f2cc51f0d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='64f6036b-99a9-40e4-8963-3cdf66964954',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98843) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 14:20:20.607359 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-25bbbfe3-b854-4bac-b699-ddcfca85b759 tempest-TestNetworkAdvancedServerOps-325372242 tempest-TestNetworkAdvancedServerOps-325372242-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:20:20.608051 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-25bbbfe3-b854-4bac-b699-ddcfca85b759 tempest-TestNetworkAdvancedServerOps-325372242 tempest-TestNetworkAdvancedServerOps-325372242-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:20:20.682512 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-25bbbfe3-b854-4bac-b699-ddcfca85b759 tempest-TestNetworkAdvancedServerOps-325372242 tempest-TestNetworkAdvancedServerOps-325372242-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:20:20.682987 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-25bbbfe3-b854-4bac-b699-ddcfca85b759 tempest-TestNetworkAdvancedServerOps-325372242 tempest-TestNetworkAdvancedServerOps-325372242-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:20:20.700651 n-d-791503-6 nova-conductor[98843]: ERROR oslo.messaging._drivers.impl_rabbit [None req-25bbbfe3-b854-4bac-b699-ddcfca85b759 tempest-TestNetworkAdvancedServerOps-325372242 tempest-TestNetworkAdvancedServerOps-325372242-project] [9282344d-1714-453f-af6a-f153528668cb] AMQP server on 10.222.0.68:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 28 14:20:21.730983 n-d-791503-6 nova-conductor[98843]: INFO oslo.messaging._drivers.impl_rabbit [None req-25bbbfe3-b854-4bac-b699-ddcfca85b759 tempest-TestNetworkAdvancedServerOps-325372242 tempest-TestNetworkAdvancedServerOps-325372242-project] [9282344d-1714-453f-af6a-f153528668cb] Reconnected to AMQP server on 10.222.0.68:5672 via [amqp] client with port 43448. May 28 14:20:26.958688 n-d-791503-6 nova-conductor[98844]: ERROR oslo.messaging._drivers.impl_rabbit [-] [8840711a-c4c2-4555-9645-ce157ee9cc0d] AMQP server on 10.222.0.68:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 28 14:20:28.069826 n-d-791503-6 nova-conductor[98844]: INFO oslo.messaging._drivers.impl_rabbit [-] [8840711a-c4c2-4555-9645-ce157ee9cc0d] Reconnected to AMQP server on 10.222.0.68:5672 via [amqp] client with port 43536. May 28 14:20:40.020844 n-d-791503-6 nova-conductor[98844]: ERROR oslo.messaging._drivers.impl_rabbit [-] [cbd7c90c-b59a-4f8b-992f-d04ba5ad6f9c] AMQP server on 10.222.0.68:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection May 28 14:20:41.083681 n-d-791503-6 nova-conductor[98844]: INFO oslo.messaging._drivers.impl_rabbit [-] [cbd7c90c-b59a-4f8b-992f-d04ba5ad6f9c] Reconnected to AMQP server on 10.222.0.68:5672 via [amqp] client with port 43728. May 28 14:20:45.212546 n-d-791503-6 nova-conductor[98844]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 14:20:46.152466 n-d-791503-6 nova-conductor[98844]: ERROR oslo.messaging._drivers.impl_rabbit [-] [abccac45-5c00-4182-bcd1-fb6828b957ad] AMQP server on 10.222.0.68:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 28 14:20:47.240198 n-d-791503-6 nova-conductor[98844]: INFO oslo.messaging._drivers.impl_rabbit [-] [abccac45-5c00-4182-bcd1-fb6828b957ad] Reconnected to AMQP server on 10.222.0.68:5672 via [amqp] client with port 43840. May 28 14:20:47.829019 n-d-791503-6 nova-conductor[98844]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 14:20:47.942972 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-f0bb670a-e6ab-4146-8f1c-b6f1ae8ff46b tempest-TestVolumeBootPattern-1064630590 tempest-TestVolumeBootPattern-1064630590-project] Took 1.17 seconds to select destinations for 1 instance(s). {{(pid=98843) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 14:20:48.024718 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-f0bb670a-e6ab-4146-8f1c-b6f1ae8ff46b tempest-TestVolumeBootPattern-1064630590 tempest-TestVolumeBootPattern-1064630590-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:20:48.025113 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-f0bb670a-e6ab-4146-8f1c-b6f1ae8ff46b tempest-TestVolumeBootPattern-1064630590 tempest-TestVolumeBootPattern-1064630590-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:20:48.157551 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-f0bb670a-e6ab-4146-8f1c-b6f1ae8ff46b tempest-TestVolumeBootPattern-1064630590 tempest-TestVolumeBootPattern-1064630590-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:20:48.158261 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-f0bb670a-e6ab-4146-8f1c-b6f1ae8ff46b tempest-TestVolumeBootPattern-1064630590 tempest-TestVolumeBootPattern-1064630590-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:20:48.163362 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-f0bb670a-e6ab-4146-8f1c-b6f1ae8ff46b tempest-TestVolumeBootPattern-1064630590 tempest-TestVolumeBootPattern-1064630590-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:20:48.164147 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-f0bb670a-e6ab-4146-8f1c-b6f1ae8ff46b tempest-TestVolumeBootPattern-1064630590 tempest-TestVolumeBootPattern-1064630590-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:20:48.218066 n-d-791503-6 nova-conductor[98843]: DEBUG nova.quota [None req-f0bb670a-e6ab-4146-8f1c-b6f1ae8ff46b tempest-TestVolumeBootPattern-1064630590 tempest-TestVolumeBootPattern-1064630590-project] Getting quotas for project 305e3a203e4f4a6587868d912011ea19. Resources: {'cores', 'ram', 'instances'} {{(pid=98843) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 14:20:48.238652 n-d-791503-6 nova-conductor[98843]: DEBUG nova.quota [None req-f0bb670a-e6ab-4146-8f1c-b6f1ae8ff46b tempest-TestVolumeBootPattern-1064630590 tempest-TestVolumeBootPattern-1064630590-project] Getting quotas for user 4369165fbbb64bb194d32c8ca9624ca3 and project 305e3a203e4f4a6587868d912011ea19. Resources: {'cores', 'ram', 'instances'} {{(pid=98843) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 14:20:48.283019 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-f0bb670a-e6ab-4146-8f1c-b6f1ae8ff46b tempest-TestVolumeBootPattern-1064630590 tempest-TestVolumeBootPattern-1064630590-project] [instance: daedcf00-786d-4423-82b6-7c64b599aebf] Selected host: n-h2-791503-6; Selected node: n-h2-791503-6; Alternates: [('n-h1-791503-6', 'n-h1-791503-6')] {{(pid=98843) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 14:20:48.289191 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-f0bb670a-e6ab-4146-8f1c-b6f1ae8ff46b tempest-TestVolumeBootPattern-1064630590 tempest-TestVolumeBootPattern-1064630590-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:20:48.290098 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-f0bb670a-e6ab-4146-8f1c-b6f1ae8ff46b tempest-TestVolumeBootPattern-1064630590 tempest-TestVolumeBootPattern-1064630590-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:20:48.308413 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-f0bb670a-e6ab-4146-8f1c-b6f1ae8ff46b tempest-TestVolumeBootPattern-1064630590 tempest-TestVolumeBootPattern-1064630590-project] [instance: daedcf00-786d-4423-82b6-7c64b599aebf] block_device_mapping [BlockDeviceMapping(attachment_id=c3fd93c0-1455-4622-9e57-bdb2e1413cf2,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='eb7b0e13-e618-4f40-87bb-3fa465fe5a4d',volume_size=1,volume_type=None)] {{(pid=98843) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 14:20:48.310376 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-f0bb670a-e6ab-4146-8f1c-b6f1ae8ff46b tempest-TestVolumeBootPattern-1064630590 tempest-TestVolumeBootPattern-1064630590-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:20:48.310983 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-f0bb670a-e6ab-4146-8f1c-b6f1ae8ff46b tempest-TestVolumeBootPattern-1064630590 tempest-TestVolumeBootPattern-1064630590-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:20:48.397204 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-f0bb670a-e6ab-4146-8f1c-b6f1ae8ff46b tempest-TestVolumeBootPattern-1064630590 tempest-TestVolumeBootPattern-1064630590-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:20:48.397856 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-f0bb670a-e6ab-4146-8f1c-b6f1ae8ff46b tempest-TestVolumeBootPattern-1064630590 tempest-TestVolumeBootPattern-1064630590-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:21:25.520094 n-d-791503-6 nova-conductor[98843]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 14:21:31.470505 n-d-791503-6 nova-conductor[98843]: ERROR oslo.messaging._drivers.impl_rabbit [-] [fb67aa64-250d-4c34-b696-14a5dd0b49b6] AMQP server on 10.222.0.68:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 28 14:21:32.529801 n-d-791503-6 nova-conductor[98843]: INFO oslo.messaging._drivers.impl_rabbit [-] [fb67aa64-250d-4c34-b696-14a5dd0b49b6] Reconnected to AMQP server on 10.222.0.68:5672 via [amqp] client with port 44614. May 28 14:21:32.843316 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.manager [None req-b16bda18-4b26-4c89-992c-9509d8f39e69 tempest-InstanceActionsTestJSON-1189997325 tempest-InstanceActionsTestJSON-1189997325-project] Took 1.89 seconds to select destinations for 1 instance(s). {{(pid=98844) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 14:21:32.929359 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-b16bda18-4b26-4c89-992c-9509d8f39e69 tempest-InstanceActionsTestJSON-1189997325 tempest-InstanceActionsTestJSON-1189997325-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:21:32.930815 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-b16bda18-4b26-4c89-992c-9509d8f39e69 tempest-InstanceActionsTestJSON-1189997325 tempest-InstanceActionsTestJSON-1189997325-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:21:33.157864 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-b16bda18-4b26-4c89-992c-9509d8f39e69 tempest-InstanceActionsTestJSON-1189997325 tempest-InstanceActionsTestJSON-1189997325-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:21:33.158528 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-b16bda18-4b26-4c89-992c-9509d8f39e69 tempest-InstanceActionsTestJSON-1189997325 tempest-InstanceActionsTestJSON-1189997325-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:21:33.162776 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-b16bda18-4b26-4c89-992c-9509d8f39e69 tempest-InstanceActionsTestJSON-1189997325 tempest-InstanceActionsTestJSON-1189997325-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:21:33.163467 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-b16bda18-4b26-4c89-992c-9509d8f39e69 tempest-InstanceActionsTestJSON-1189997325 tempest-InstanceActionsTestJSON-1189997325-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:21:33.247533 n-d-791503-6 nova-conductor[98844]: DEBUG nova.quota [None req-b16bda18-4b26-4c89-992c-9509d8f39e69 tempest-InstanceActionsTestJSON-1189997325 tempest-InstanceActionsTestJSON-1189997325-project] Getting quotas for project 6b7a25a0b1ca417fa98d1bb2c313d7cb. Resources: {'cores', 'ram', 'instances'} {{(pid=98844) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 14:21:33.268151 n-d-791503-6 nova-conductor[98844]: DEBUG nova.quota [None req-b16bda18-4b26-4c89-992c-9509d8f39e69 tempest-InstanceActionsTestJSON-1189997325 tempest-InstanceActionsTestJSON-1189997325-project] Getting quotas for user 9e5c1328a8b042bb9bf1fed26e53fb19 and project 6b7a25a0b1ca417fa98d1bb2c313d7cb. Resources: {'cores', 'ram', 'instances'} {{(pid=98844) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 14:21:33.305959 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.manager [None req-b16bda18-4b26-4c89-992c-9509d8f39e69 tempest-InstanceActionsTestJSON-1189997325 tempest-InstanceActionsTestJSON-1189997325-project] [instance: 977f1758-c28b-43eb-ba2b-a2f46943699e] Selected host: n-h1-791503-6; Selected node: n-h1-791503-6; Alternates: [('n-h2-791503-6', 'n-h2-791503-6')] {{(pid=98844) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 14:21:33.306872 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-b16bda18-4b26-4c89-992c-9509d8f39e69 tempest-InstanceActionsTestJSON-1189997325 tempest-InstanceActionsTestJSON-1189997325-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:21:33.317106 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-b16bda18-4b26-4c89-992c-9509d8f39e69 tempest-InstanceActionsTestJSON-1189997325 tempest-InstanceActionsTestJSON-1189997325-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:21:33.334537 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.manager [None req-b16bda18-4b26-4c89-992c-9509d8f39e69 tempest-InstanceActionsTestJSON-1189997325 tempest-InstanceActionsTestJSON-1189997325-project] [instance: 977f1758-c28b-43eb-ba2b-a2f46943699e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='64f6036b-99a9-40e4-8963-3cdf66964954',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98844) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 14:21:33.337172 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-b16bda18-4b26-4c89-992c-9509d8f39e69 tempest-InstanceActionsTestJSON-1189997325 tempest-InstanceActionsTestJSON-1189997325-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:21:33.337669 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-b16bda18-4b26-4c89-992c-9509d8f39e69 tempest-InstanceActionsTestJSON-1189997325 tempest-InstanceActionsTestJSON-1189997325-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:21:33.408921 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-b16bda18-4b26-4c89-992c-9509d8f39e69 tempest-InstanceActionsTestJSON-1189997325 tempest-InstanceActionsTestJSON-1189997325-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:21:33.409424 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-b16bda18-4b26-4c89-992c-9509d8f39e69 tempest-InstanceActionsTestJSON-1189997325 tempest-InstanceActionsTestJSON-1189997325-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:21:56.212330 n-d-791503-6 nova-conductor[98844]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 14:22:02.528554 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-98af239f-c6ce-447d-a273-0b5262d5b6a8 tempest-TestNetworkAdvancedServerOps-360935568 tempest-TestNetworkAdvancedServerOps-360935568-project-admin] Targeting cell b241212c-c279-4fbb-a1e7-b87889287cbf(cell1) for conductor method migrate_server {{(pid=98843) wrapper /opt/stack/nova/nova/conductor/manager.py:91}} May 28 14:22:02.529125 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-98af239f-c6ce-447d-a273-0b5262d5b6a8 tempest-TestNetworkAdvancedServerOps-360935568 tempest-TestNetworkAdvancedServerOps-360935568-project-admin] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:22:02.529529 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-98af239f-c6ce-447d-a273-0b5262d5b6a8 tempest-TestNetworkAdvancedServerOps-360935568 tempest-TestNetworkAdvancedServerOps-360935568-project-admin] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:22:03.212233 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.tasks.migrate [None req-98af239f-c6ce-447d-a273-0b5262d5b6a8 tempest-TestNetworkAdvancedServerOps-360935568 tempest-TestNetworkAdvancedServerOps-360935568-project-admin] [instance: c1f3f823-37b9-4b63-95b5-d97f2cc51f0d] Restricting to cell b241212c-c279-4fbb-a1e7-b87889287cbf(cell1) while migrating {{(pid=98843) _set_requested_destination_cell /opt/stack/nova/nova/conductor/tasks/migrate.py:208}} May 28 14:22:04.251221 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.tasks.migrate [None req-98af239f-c6ce-447d-a273-0b5262d5b6a8 tempest-TestNetworkAdvancedServerOps-360935568 tempest-TestNetworkAdvancedServerOps-360935568-project-admin] Created allocations for migration d169c870-b90f-4bc4-b8ae-2b431b6bd05b on d4341c2e-3ff0-43f5-9b7e-4ec6191a47d4 {{(pid=98843) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} May 28 14:22:04.939049 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.tasks.migrate [None req-98af239f-c6ce-447d-a273-0b5262d5b6a8 tempest-TestNetworkAdvancedServerOps-360935568 tempest-TestNetworkAdvancedServerOps-360935568-project-admin] [instance: c1f3f823-37b9-4b63-95b5-d97f2cc51f0d] Calling prep_resize with selected host: n-h2-791503-6; Selected node: n-h2-791503-6; Alternates: [] {{(pid=98843) _execute /opt/stack/nova/nova/conductor/tasks/migrate.py:315}} May 28 14:22:32.633122 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.manager [None req-29ceb75f-7596-4428-b96e-72502eecf8c3 tempest-MultipleCreateTestJSON-1351956103 tempest-MultipleCreateTestJSON-1351956103-project] Took 1.47 seconds to select destinations for 2 instance(s). {{(pid=98844) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 14:22:32.785789 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-29ceb75f-7596-4428-b96e-72502eecf8c3 tempest-MultipleCreateTestJSON-1351956103 tempest-MultipleCreateTestJSON-1351956103-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:22:32.786796 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-29ceb75f-7596-4428-b96e-72502eecf8c3 tempest-MultipleCreateTestJSON-1351956103 tempest-MultipleCreateTestJSON-1351956103-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:22:33.078761 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-29ceb75f-7596-4428-b96e-72502eecf8c3 tempest-MultipleCreateTestJSON-1351956103 tempest-MultipleCreateTestJSON-1351956103-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:22:33.079440 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-29ceb75f-7596-4428-b96e-72502eecf8c3 tempest-MultipleCreateTestJSON-1351956103 tempest-MultipleCreateTestJSON-1351956103-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:22:33.532424 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-29ceb75f-7596-4428-b96e-72502eecf8c3 tempest-MultipleCreateTestJSON-1351956103 tempest-MultipleCreateTestJSON-1351956103-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:22:33.533212 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-29ceb75f-7596-4428-b96e-72502eecf8c3 tempest-MultipleCreateTestJSON-1351956103 tempest-MultipleCreateTestJSON-1351956103-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:22:33.534480 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-29ceb75f-7596-4428-b96e-72502eecf8c3 tempest-MultipleCreateTestJSON-1351956103 tempest-MultipleCreateTestJSON-1351956103-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:22:33.535186 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-29ceb75f-7596-4428-b96e-72502eecf8c3 tempest-MultipleCreateTestJSON-1351956103 tempest-MultipleCreateTestJSON-1351956103-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:22:33.650574 n-d-791503-6 nova-conductor[98844]: DEBUG nova.quota [None req-29ceb75f-7596-4428-b96e-72502eecf8c3 tempest-MultipleCreateTestJSON-1351956103 tempest-MultipleCreateTestJSON-1351956103-project] Getting quotas for project 759ed379c7394181976befc1c8ca3bbb. Resources: {'cores', 'ram', 'instances'} {{(pid=98844) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 14:22:33.727759 n-d-791503-6 nova-conductor[98844]: DEBUG nova.quota [None req-29ceb75f-7596-4428-b96e-72502eecf8c3 tempest-MultipleCreateTestJSON-1351956103 tempest-MultipleCreateTestJSON-1351956103-project] Getting quotas for user 0e39d9cbe032474da889225d9c2630a2 and project 759ed379c7394181976befc1c8ca3bbb. Resources: {'cores', 'ram', 'instances'} {{(pid=98844) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 14:22:33.808882 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.manager [None req-29ceb75f-7596-4428-b96e-72502eecf8c3 tempest-MultipleCreateTestJSON-1351956103 tempest-MultipleCreateTestJSON-1351956103-project] [instance: 9f98c831-99d1-4e14-9107-2375ec60969c] Selected host: n-h2-791503-6; Selected node: n-h2-791503-6; Alternates: [] {{(pid=98844) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 14:22:33.816410 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-29ceb75f-7596-4428-b96e-72502eecf8c3 tempest-MultipleCreateTestJSON-1351956103 tempest-MultipleCreateTestJSON-1351956103-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:22:33.824060 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-29ceb75f-7596-4428-b96e-72502eecf8c3 tempest-MultipleCreateTestJSON-1351956103 tempest-MultipleCreateTestJSON-1351956103-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:22:33.846722 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.manager [None req-29ceb75f-7596-4428-b96e-72502eecf8c3 tempest-MultipleCreateTestJSON-1351956103 tempest-MultipleCreateTestJSON-1351956103-project] [instance: 9f98c831-99d1-4e14-9107-2375ec60969c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='64f6036b-99a9-40e4-8963-3cdf66964954',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98844) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 14:22:33.853924 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-29ceb75f-7596-4428-b96e-72502eecf8c3 tempest-MultipleCreateTestJSON-1351956103 tempest-MultipleCreateTestJSON-1351956103-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:22:33.857306 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-29ceb75f-7596-4428-b96e-72502eecf8c3 tempest-MultipleCreateTestJSON-1351956103 tempest-MultipleCreateTestJSON-1351956103-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:22:33.991964 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-29ceb75f-7596-4428-b96e-72502eecf8c3 tempest-MultipleCreateTestJSON-1351956103 tempest-MultipleCreateTestJSON-1351956103-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:22:33.993151 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-29ceb75f-7596-4428-b96e-72502eecf8c3 tempest-MultipleCreateTestJSON-1351956103 tempest-MultipleCreateTestJSON-1351956103-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:22:34.044543 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.manager [None req-29ceb75f-7596-4428-b96e-72502eecf8c3 tempest-MultipleCreateTestJSON-1351956103 tempest-MultipleCreateTestJSON-1351956103-project] [instance: c723caaa-bce4-4d14-bb19-0b538d4fea6a] Selected host: n-h1-791503-6; Selected node: n-h1-791503-6; Alternates: [] {{(pid=98844) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 14:22:34.047633 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-29ceb75f-7596-4428-b96e-72502eecf8c3 tempest-MultipleCreateTestJSON-1351956103 tempest-MultipleCreateTestJSON-1351956103-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:22:34.048654 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-29ceb75f-7596-4428-b96e-72502eecf8c3 tempest-MultipleCreateTestJSON-1351956103 tempest-MultipleCreateTestJSON-1351956103-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:22:34.066151 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.manager [None req-29ceb75f-7596-4428-b96e-72502eecf8c3 tempest-MultipleCreateTestJSON-1351956103 tempest-MultipleCreateTestJSON-1351956103-project] [instance: c723caaa-bce4-4d14-bb19-0b538d4fea6a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='64f6036b-99a9-40e4-8963-3cdf66964954',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98844) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 14:22:34.069509 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-29ceb75f-7596-4428-b96e-72502eecf8c3 tempest-MultipleCreateTestJSON-1351956103 tempest-MultipleCreateTestJSON-1351956103-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:22:34.070709 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-29ceb75f-7596-4428-b96e-72502eecf8c3 tempest-MultipleCreateTestJSON-1351956103 tempest-MultipleCreateTestJSON-1351956103-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:22:34.203923 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-29ceb75f-7596-4428-b96e-72502eecf8c3 tempest-MultipleCreateTestJSON-1351956103 tempest-MultipleCreateTestJSON-1351956103-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:22:34.204646 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-29ceb75f-7596-4428-b96e-72502eecf8c3 tempest-MultipleCreateTestJSON-1351956103 tempest-MultipleCreateTestJSON-1351956103-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:23:41.085404 n-d-791503-6 nova-conductor[98844]: ERROR oslo.messaging._drivers.impl_rabbit [-] [cbd7c90c-b59a-4f8b-992f-d04ba5ad6f9c] AMQP server on 10.222.0.68:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection May 28 14:23:42.147610 n-d-791503-6 nova-conductor[98844]: INFO oslo.messaging._drivers.impl_rabbit [-] [cbd7c90c-b59a-4f8b-992f-d04ba5ad6f9c] Reconnected to AMQP server on 10.222.0.68:5672 via [amqp] client with port 46628. May 28 14:23:47.042136 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.manager [None req-e6b4c945-e8d7-445d-9653-f0ee2063d93c tempest-TestVolumeBootPattern-1064630590 tempest-TestVolumeBootPattern-1064630590-project] Took 1.07 seconds to select destinations for 1 instance(s). {{(pid=98844) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 14:23:47.135447 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-70960620-572a-4c21-8911-ef8e712cd6cf tempest-MultipleCreateTestJSON-1351956103 tempest-MultipleCreateTestJSON-1351956103-project] Took 1.42 seconds to select destinations for 2 instance(s). {{(pid=98843) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 14:23:47.200397 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-e6b4c945-e8d7-445d-9653-f0ee2063d93c tempest-TestVolumeBootPattern-1064630590 tempest-TestVolumeBootPattern-1064630590-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:23:47.200982 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-e6b4c945-e8d7-445d-9653-f0ee2063d93c tempest-TestVolumeBootPattern-1064630590 tempest-TestVolumeBootPattern-1064630590-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:23:47.228075 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-70960620-572a-4c21-8911-ef8e712cd6cf tempest-MultipleCreateTestJSON-1351956103 tempest-MultipleCreateTestJSON-1351956103-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:23:47.228708 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-70960620-572a-4c21-8911-ef8e712cd6cf tempest-MultipleCreateTestJSON-1351956103 tempest-MultipleCreateTestJSON-1351956103-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:23:47.401208 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-e6b4c945-e8d7-445d-9653-f0ee2063d93c tempest-TestVolumeBootPattern-1064630590 tempest-TestVolumeBootPattern-1064630590-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:23:47.405943 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-e6b4c945-e8d7-445d-9653-f0ee2063d93c tempest-TestVolumeBootPattern-1064630590 tempest-TestVolumeBootPattern-1064630590-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:23:47.415191 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-e6b4c945-e8d7-445d-9653-f0ee2063d93c tempest-TestVolumeBootPattern-1064630590 tempest-TestVolumeBootPattern-1064630590-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:23:47.416326 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-e6b4c945-e8d7-445d-9653-f0ee2063d93c tempest-TestVolumeBootPattern-1064630590 tempest-TestVolumeBootPattern-1064630590-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:23:47.450332 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-70960620-572a-4c21-8911-ef8e712cd6cf tempest-MultipleCreateTestJSON-1351956103 tempest-MultipleCreateTestJSON-1351956103-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:23:47.451086 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-70960620-572a-4c21-8911-ef8e712cd6cf tempest-MultipleCreateTestJSON-1351956103 tempest-MultipleCreateTestJSON-1351956103-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:23:47.494971 n-d-791503-6 nova-conductor[98844]: DEBUG nova.quota [None req-e6b4c945-e8d7-445d-9653-f0ee2063d93c tempest-TestVolumeBootPattern-1064630590 tempest-TestVolumeBootPattern-1064630590-project] Getting quotas for project 305e3a203e4f4a6587868d912011ea19. Resources: {'cores', 'ram', 'instances'} {{(pid=98844) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 14:23:47.517184 n-d-791503-6 nova-conductor[98844]: DEBUG nova.quota [None req-e6b4c945-e8d7-445d-9653-f0ee2063d93c tempest-TestVolumeBootPattern-1064630590 tempest-TestVolumeBootPattern-1064630590-project] Getting quotas for user 4369165fbbb64bb194d32c8ca9624ca3 and project 305e3a203e4f4a6587868d912011ea19. Resources: {'cores', 'ram', 'instances'} {{(pid=98844) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 14:23:47.565475 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.manager [None req-e6b4c945-e8d7-445d-9653-f0ee2063d93c tempest-TestVolumeBootPattern-1064630590 tempest-TestVolumeBootPattern-1064630590-project] [instance: 92017a3d-4442-43ee-b93c-1d62eb709a1f] Selected host: n-h1-791503-6; Selected node: n-h1-791503-6; Alternates: [('n-h2-791503-6', 'n-h2-791503-6')] {{(pid=98844) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 14:23:47.567624 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-e6b4c945-e8d7-445d-9653-f0ee2063d93c tempest-TestVolumeBootPattern-1064630590 tempest-TestVolumeBootPattern-1064630590-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:23:47.569030 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-e6b4c945-e8d7-445d-9653-f0ee2063d93c tempest-TestVolumeBootPattern-1064630590 tempest-TestVolumeBootPattern-1064630590-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:23:47.589727 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.manager [None req-e6b4c945-e8d7-445d-9653-f0ee2063d93c tempest-TestVolumeBootPattern-1064630590 tempest-TestVolumeBootPattern-1064630590-project] [instance: 92017a3d-4442-43ee-b93c-1d62eb709a1f] block_device_mapping [BlockDeviceMapping(attachment_id=bb09f4dc-c7a2-47b4-bd45-e2ab4beb2b74,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ec48f81d-4440-4999-a86b-c2f8763f7674',volume_size=1,volume_type=None)] {{(pid=98844) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 14:23:47.594142 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-e6b4c945-e8d7-445d-9653-f0ee2063d93c tempest-TestVolumeBootPattern-1064630590 tempest-TestVolumeBootPattern-1064630590-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:23:47.595457 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-e6b4c945-e8d7-445d-9653-f0ee2063d93c tempest-TestVolumeBootPattern-1064630590 tempest-TestVolumeBootPattern-1064630590-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:23:47.601407 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-70960620-572a-4c21-8911-ef8e712cd6cf tempest-MultipleCreateTestJSON-1351956103 tempest-MultipleCreateTestJSON-1351956103-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:23:47.602047 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-70960620-572a-4c21-8911-ef8e712cd6cf tempest-MultipleCreateTestJSON-1351956103 tempest-MultipleCreateTestJSON-1351956103-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:23:47.603250 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-70960620-572a-4c21-8911-ef8e712cd6cf tempest-MultipleCreateTestJSON-1351956103 tempest-MultipleCreateTestJSON-1351956103-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:23:47.603870 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-70960620-572a-4c21-8911-ef8e712cd6cf tempest-MultipleCreateTestJSON-1351956103 tempest-MultipleCreateTestJSON-1351956103-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:23:47.672713 n-d-791503-6 nova-conductor[98843]: DEBUG nova.quota [None req-70960620-572a-4c21-8911-ef8e712cd6cf tempest-MultipleCreateTestJSON-1351956103 tempest-MultipleCreateTestJSON-1351956103-project] Getting quotas for project 759ed379c7394181976befc1c8ca3bbb. Resources: {'cores', 'ram', 'instances'} {{(pid=98843) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 14:23:47.685916 n-d-791503-6 nova-conductor[98843]: DEBUG nova.quota [None req-70960620-572a-4c21-8911-ef8e712cd6cf tempest-MultipleCreateTestJSON-1351956103 tempest-MultipleCreateTestJSON-1351956103-project] Getting quotas for user 0e39d9cbe032474da889225d9c2630a2 and project 759ed379c7394181976befc1c8ca3bbb. Resources: {'cores', 'ram', 'instances'} {{(pid=98843) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 14:23:47.737088 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-70960620-572a-4c21-8911-ef8e712cd6cf tempest-MultipleCreateTestJSON-1351956103 tempest-MultipleCreateTestJSON-1351956103-project] [instance: a1b9e93b-01a7-48a6-aabe-09f3d917d857] Selected host: n-h1-791503-6; Selected node: n-h1-791503-6; Alternates: [] {{(pid=98843) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 14:23:47.738675 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-70960620-572a-4c21-8911-ef8e712cd6cf tempest-MultipleCreateTestJSON-1351956103 tempest-MultipleCreateTestJSON-1351956103-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:23:47.739439 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-70960620-572a-4c21-8911-ef8e712cd6cf tempest-MultipleCreateTestJSON-1351956103 tempest-MultipleCreateTestJSON-1351956103-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:23:47.751196 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-e6b4c945-e8d7-445d-9653-f0ee2063d93c tempest-TestVolumeBootPattern-1064630590 tempest-TestVolumeBootPattern-1064630590-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:23:47.754748 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-e6b4c945-e8d7-445d-9653-f0ee2063d93c tempest-TestVolumeBootPattern-1064630590 tempest-TestVolumeBootPattern-1064630590-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:23:47.759870 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-70960620-572a-4c21-8911-ef8e712cd6cf tempest-MultipleCreateTestJSON-1351956103 tempest-MultipleCreateTestJSON-1351956103-project] [instance: a1b9e93b-01a7-48a6-aabe-09f3d917d857] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='64f6036b-99a9-40e4-8963-3cdf66964954',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98843) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 14:23:47.763191 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-70960620-572a-4c21-8911-ef8e712cd6cf tempest-MultipleCreateTestJSON-1351956103 tempest-MultipleCreateTestJSON-1351956103-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:23:47.763473 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-70960620-572a-4c21-8911-ef8e712cd6cf tempest-MultipleCreateTestJSON-1351956103 tempest-MultipleCreateTestJSON-1351956103-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:23:47.897142 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-70960620-572a-4c21-8911-ef8e712cd6cf tempest-MultipleCreateTestJSON-1351956103 tempest-MultipleCreateTestJSON-1351956103-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:23:47.899146 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-70960620-572a-4c21-8911-ef8e712cd6cf tempest-MultipleCreateTestJSON-1351956103 tempest-MultipleCreateTestJSON-1351956103-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:23:47.974818 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-70960620-572a-4c21-8911-ef8e712cd6cf tempest-MultipleCreateTestJSON-1351956103 tempest-MultipleCreateTestJSON-1351956103-project] [instance: 94c5ce1e-c831-41b4-9c65-0619e044967f] Selected host: n-h2-791503-6; Selected node: n-h2-791503-6; Alternates: [] {{(pid=98843) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 14:23:47.976651 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-70960620-572a-4c21-8911-ef8e712cd6cf tempest-MultipleCreateTestJSON-1351956103 tempest-MultipleCreateTestJSON-1351956103-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:23:47.977354 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-70960620-572a-4c21-8911-ef8e712cd6cf tempest-MultipleCreateTestJSON-1351956103 tempest-MultipleCreateTestJSON-1351956103-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:23:47.999590 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-70960620-572a-4c21-8911-ef8e712cd6cf tempest-MultipleCreateTestJSON-1351956103 tempest-MultipleCreateTestJSON-1351956103-project] [instance: 94c5ce1e-c831-41b4-9c65-0619e044967f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='64f6036b-99a9-40e4-8963-3cdf66964954',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98843) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 14:23:48.002551 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-70960620-572a-4c21-8911-ef8e712cd6cf tempest-MultipleCreateTestJSON-1351956103 tempest-MultipleCreateTestJSON-1351956103-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:23:48.005170 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-70960620-572a-4c21-8911-ef8e712cd6cf tempest-MultipleCreateTestJSON-1351956103 tempest-MultipleCreateTestJSON-1351956103-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:23:48.158780 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-70960620-572a-4c21-8911-ef8e712cd6cf tempest-MultipleCreateTestJSON-1351956103 tempest-MultipleCreateTestJSON-1351956103-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:23:48.172516 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-70960620-572a-4c21-8911-ef8e712cd6cf tempest-MultipleCreateTestJSON-1351956103 tempest-MultipleCreateTestJSON-1351956103-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:24:32.524455 n-d-791503-6 nova-conductor[98843]: ERROR oslo.messaging._drivers.impl_rabbit [-] [fb67aa64-250d-4c34-b696-14a5dd0b49b6] AMQP server on 10.222.0.68:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection May 28 14:24:33.563747 n-d-791503-6 nova-conductor[98843]: INFO oslo.messaging._drivers.impl_rabbit [-] [fb67aa64-250d-4c34-b696-14a5dd0b49b6] Reconnected to AMQP server on 10.222.0.68:5672 via [amqp] client with port 47178. May 28 14:24:43.676018 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-5ac9c4de-6ff3-4c5a-b154-d2df6da21fe2 tempest-TestSecurityGroupsBasicOps-1631877101 tempest-TestSecurityGroupsBasicOps-1631877101-project] Took 1.03 seconds to select destinations for 1 instance(s). {{(pid=98843) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 14:24:43.772034 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-5ac9c4de-6ff3-4c5a-b154-d2df6da21fe2 tempest-TestSecurityGroupsBasicOps-1631877101 tempest-TestSecurityGroupsBasicOps-1631877101-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:24:43.773268 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-5ac9c4de-6ff3-4c5a-b154-d2df6da21fe2 tempest-TestSecurityGroupsBasicOps-1631877101 tempest-TestSecurityGroupsBasicOps-1631877101-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:24:43.998299 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-5ac9c4de-6ff3-4c5a-b154-d2df6da21fe2 tempest-TestSecurityGroupsBasicOps-1631877101 tempest-TestSecurityGroupsBasicOps-1631877101-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:24:43.998971 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-5ac9c4de-6ff3-4c5a-b154-d2df6da21fe2 tempest-TestSecurityGroupsBasicOps-1631877101 tempest-TestSecurityGroupsBasicOps-1631877101-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:24:44.000351 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-5ac9c4de-6ff3-4c5a-b154-d2df6da21fe2 tempest-TestSecurityGroupsBasicOps-1631877101 tempest-TestSecurityGroupsBasicOps-1631877101-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:24:44.001552 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-5ac9c4de-6ff3-4c5a-b154-d2df6da21fe2 tempest-TestSecurityGroupsBasicOps-1631877101 tempest-TestSecurityGroupsBasicOps-1631877101-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:24:44.049036 n-d-791503-6 nova-conductor[98843]: DEBUG nova.quota [None req-5ac9c4de-6ff3-4c5a-b154-d2df6da21fe2 tempest-TestSecurityGroupsBasicOps-1631877101 tempest-TestSecurityGroupsBasicOps-1631877101-project] Getting quotas for project 0962ce1c4ca94a80a5c265c1978d4e09. Resources: {'cores', 'ram', 'instances'} {{(pid=98843) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 14:24:44.078542 n-d-791503-6 nova-conductor[98843]: DEBUG nova.quota [None req-5ac9c4de-6ff3-4c5a-b154-d2df6da21fe2 tempest-TestSecurityGroupsBasicOps-1631877101 tempest-TestSecurityGroupsBasicOps-1631877101-project] Getting quotas for user ce31a2651d7844e9a812e65733d7991f and project 0962ce1c4ca94a80a5c265c1978d4e09. Resources: {'cores', 'ram', 'instances'} {{(pid=98843) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 14:24:44.177522 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-5ac9c4de-6ff3-4c5a-b154-d2df6da21fe2 tempest-TestSecurityGroupsBasicOps-1631877101 tempest-TestSecurityGroupsBasicOps-1631877101-project] [instance: de28eb1f-b973-4fe5-b3bf-37b49d9c7564] Selected host: n-h2-791503-6; Selected node: n-h2-791503-6; Alternates: [('n-h1-791503-6', 'n-h1-791503-6')] {{(pid=98843) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 14:24:44.184362 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-5ac9c4de-6ff3-4c5a-b154-d2df6da21fe2 tempest-TestSecurityGroupsBasicOps-1631877101 tempest-TestSecurityGroupsBasicOps-1631877101-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:24:44.185681 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-5ac9c4de-6ff3-4c5a-b154-d2df6da21fe2 tempest-TestSecurityGroupsBasicOps-1631877101 tempest-TestSecurityGroupsBasicOps-1631877101-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:24:44.199380 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-5ac9c4de-6ff3-4c5a-b154-d2df6da21fe2 tempest-TestSecurityGroupsBasicOps-1631877101 tempest-TestSecurityGroupsBasicOps-1631877101-project] [instance: de28eb1f-b973-4fe5-b3bf-37b49d9c7564] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='64f6036b-99a9-40e4-8963-3cdf66964954',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98843) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 14:24:44.202318 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-5ac9c4de-6ff3-4c5a-b154-d2df6da21fe2 tempest-TestSecurityGroupsBasicOps-1631877101 tempest-TestSecurityGroupsBasicOps-1631877101-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:24:44.203322 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-5ac9c4de-6ff3-4c5a-b154-d2df6da21fe2 tempest-TestSecurityGroupsBasicOps-1631877101 tempest-TestSecurityGroupsBasicOps-1631877101-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:24:44.271309 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-5ac9c4de-6ff3-4c5a-b154-d2df6da21fe2 tempest-TestSecurityGroupsBasicOps-1631877101 tempest-TestSecurityGroupsBasicOps-1631877101-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:24:44.272753 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-5ac9c4de-6ff3-4c5a-b154-d2df6da21fe2 tempest-TestSecurityGroupsBasicOps-1631877101 tempest-TestSecurityGroupsBasicOps-1631877101-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:24:45.564625 n-d-791503-6 nova-conductor[98843]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 14:25:16.249628 n-d-791503-6 nova-conductor[98844]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 14:25:33.872908 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.manager [None req-39d4a5a6-496b-4ea2-8bde-1f47c1f4d002 tempest-ServersNegativeTestMultiTenantJSON-206589396 tempest-ServersNegativeTestMultiTenantJSON-206589396-project] Took 0.42 seconds to select destinations for 1 instance(s). {{(pid=98844) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 14:25:33.917911 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-39d4a5a6-496b-4ea2-8bde-1f47c1f4d002 tempest-ServersNegativeTestMultiTenantJSON-206589396 tempest-ServersNegativeTestMultiTenantJSON-206589396-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:33.917911 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-39d4a5a6-496b-4ea2-8bde-1f47c1f4d002 tempest-ServersNegativeTestMultiTenantJSON-206589396 tempest-ServersNegativeTestMultiTenantJSON-206589396-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:34.045236 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-39d4a5a6-496b-4ea2-8bde-1f47c1f4d002 tempest-ServersNegativeTestMultiTenantJSON-206589396 tempest-ServersNegativeTestMultiTenantJSON-206589396-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:34.046282 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-39d4a5a6-496b-4ea2-8bde-1f47c1f4d002 tempest-ServersNegativeTestMultiTenantJSON-206589396 tempest-ServersNegativeTestMultiTenantJSON-206589396-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:34.048400 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-39d4a5a6-496b-4ea2-8bde-1f47c1f4d002 tempest-ServersNegativeTestMultiTenantJSON-206589396 tempest-ServersNegativeTestMultiTenantJSON-206589396-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:34.049397 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-39d4a5a6-496b-4ea2-8bde-1f47c1f4d002 tempest-ServersNegativeTestMultiTenantJSON-206589396 tempest-ServersNegativeTestMultiTenantJSON-206589396-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:34.136330 n-d-791503-6 nova-conductor[98844]: DEBUG nova.quota [None req-39d4a5a6-496b-4ea2-8bde-1f47c1f4d002 tempest-ServersNegativeTestMultiTenantJSON-206589396 tempest-ServersNegativeTestMultiTenantJSON-206589396-project] Getting quotas for project a6ec741bab25406d93041701dbe0cd2e. Resources: {'cores', 'ram', 'instances'} {{(pid=98844) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 14:25:34.147842 n-d-791503-6 nova-conductor[98844]: DEBUG nova.quota [None req-39d4a5a6-496b-4ea2-8bde-1f47c1f4d002 tempest-ServersNegativeTestMultiTenantJSON-206589396 tempest-ServersNegativeTestMultiTenantJSON-206589396-project] Getting quotas for user 83477899c6ef4a83ba84f24f9ba2ec23 and project a6ec741bab25406d93041701dbe0cd2e. Resources: {'cores', 'ram', 'instances'} {{(pid=98844) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 14:25:34.172735 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.manager [None req-39d4a5a6-496b-4ea2-8bde-1f47c1f4d002 tempest-ServersNegativeTestMultiTenantJSON-206589396 tempest-ServersNegativeTestMultiTenantJSON-206589396-project] [instance: 9d0fee44-0f45-4ea2-baa7-4a064c21d58c] Selected host: n-h1-791503-6; Selected node: n-h1-791503-6; Alternates: [('n-h2-791503-6', 'n-h2-791503-6')] {{(pid=98844) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 14:25:34.174569 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-39d4a5a6-496b-4ea2-8bde-1f47c1f4d002 tempest-ServersNegativeTestMultiTenantJSON-206589396 tempest-ServersNegativeTestMultiTenantJSON-206589396-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:34.176314 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-39d4a5a6-496b-4ea2-8bde-1f47c1f4d002 tempest-ServersNegativeTestMultiTenantJSON-206589396 tempest-ServersNegativeTestMultiTenantJSON-206589396-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:34.196352 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.manager [None req-39d4a5a6-496b-4ea2-8bde-1f47c1f4d002 tempest-ServersNegativeTestMultiTenantJSON-206589396 tempest-ServersNegativeTestMultiTenantJSON-206589396-project] [instance: 9d0fee44-0f45-4ea2-baa7-4a064c21d58c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='64f6036b-99a9-40e4-8963-3cdf66964954',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98844) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 14:25:34.199095 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-39d4a5a6-496b-4ea2-8bde-1f47c1f4d002 tempest-ServersNegativeTestMultiTenantJSON-206589396 tempest-ServersNegativeTestMultiTenantJSON-206589396-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:34.199584 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-39d4a5a6-496b-4ea2-8bde-1f47c1f4d002 tempest-ServersNegativeTestMultiTenantJSON-206589396 tempest-ServersNegativeTestMultiTenantJSON-206589396-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:34.270160 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-39d4a5a6-496b-4ea2-8bde-1f47c1f4d002 tempest-ServersNegativeTestMultiTenantJSON-206589396 tempest-ServersNegativeTestMultiTenantJSON-206589396-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:34.271277 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-39d4a5a6-496b-4ea2-8bde-1f47c1f4d002 tempest-ServersNegativeTestMultiTenantJSON-206589396 tempest-ServersNegativeTestMultiTenantJSON-206589396-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:47.459149 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-48d9efb2-bb0d-41a7-9242-baab824f8951 tempest-TestVolumeBackupRestore-300009580 tempest-TestVolumeBackupRestore-300009580-project] Took 0.91 seconds to select destinations for 1 instance(s). {{(pid=98843) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 14:25:47.558656 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-48d9efb2-bb0d-41a7-9242-baab824f8951 tempest-TestVolumeBackupRestore-300009580 tempest-TestVolumeBackupRestore-300009580-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:47.559881 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-48d9efb2-bb0d-41a7-9242-baab824f8951 tempest-TestVolumeBackupRestore-300009580 tempest-TestVolumeBackupRestore-300009580-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:47.727332 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-48d9efb2-bb0d-41a7-9242-baab824f8951 tempest-TestVolumeBackupRestore-300009580 tempest-TestVolumeBackupRestore-300009580-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:47.728112 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-48d9efb2-bb0d-41a7-9242-baab824f8951 tempest-TestVolumeBackupRestore-300009580 tempest-TestVolumeBackupRestore-300009580-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:47.729720 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-48d9efb2-bb0d-41a7-9242-baab824f8951 tempest-TestVolumeBackupRestore-300009580 tempest-TestVolumeBackupRestore-300009580-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:47.730277 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-48d9efb2-bb0d-41a7-9242-baab824f8951 tempest-TestVolumeBackupRestore-300009580 tempest-TestVolumeBackupRestore-300009580-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:47.768558 n-d-791503-6 nova-conductor[98843]: DEBUG nova.quota [None req-48d9efb2-bb0d-41a7-9242-baab824f8951 tempest-TestVolumeBackupRestore-300009580 tempest-TestVolumeBackupRestore-300009580-project] Getting quotas for project 1bfa04cfed2f4e65b2e24a1c4df71fa6. Resources: {'cores', 'ram', 'instances'} {{(pid=98843) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 14:25:47.778972 n-d-791503-6 nova-conductor[98843]: DEBUG nova.quota [None req-48d9efb2-bb0d-41a7-9242-baab824f8951 tempest-TestVolumeBackupRestore-300009580 tempest-TestVolumeBackupRestore-300009580-project] Getting quotas for user cef5fc7b28be4386873f3b4a54a0137e and project 1bfa04cfed2f4e65b2e24a1c4df71fa6. Resources: {'cores', 'ram', 'instances'} {{(pid=98843) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 14:25:47.803323 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-48d9efb2-bb0d-41a7-9242-baab824f8951 tempest-TestVolumeBackupRestore-300009580 tempest-TestVolumeBackupRestore-300009580-project] [instance: eb6b7b05-b36c-4cca-ac64-7fcac18411fa] Selected host: n-h1-791503-6; Selected node: n-h1-791503-6; Alternates: [('n-h2-791503-6', 'n-h2-791503-6')] {{(pid=98843) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 14:25:47.805441 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-48d9efb2-bb0d-41a7-9242-baab824f8951 tempest-TestVolumeBackupRestore-300009580 tempest-TestVolumeBackupRestore-300009580-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:47.806846 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-48d9efb2-bb0d-41a7-9242-baab824f8951 tempest-TestVolumeBackupRestore-300009580 tempest-TestVolumeBackupRestore-300009580-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:47.829661 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-48d9efb2-bb0d-41a7-9242-baab824f8951 tempest-TestVolumeBackupRestore-300009580 tempest-TestVolumeBackupRestore-300009580-project] [instance: eb6b7b05-b36c-4cca-ac64-7fcac18411fa] block_device_mapping [BlockDeviceMapping(attachment_id=525a1b42-9a20-43e9-b25d-c324fced3448,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f8a7b1e9-9262-4f97-ac9e-0bf0ebe4a12a',volume_size=1,volume_type=None)] {{(pid=98843) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 14:25:47.833037 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-48d9efb2-bb0d-41a7-9242-baab824f8951 tempest-TestVolumeBackupRestore-300009580 tempest-TestVolumeBackupRestore-300009580-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:47.833855 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-48d9efb2-bb0d-41a7-9242-baab824f8951 tempest-TestVolumeBackupRestore-300009580 tempest-TestVolumeBackupRestore-300009580-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:25:47.904156 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-48d9efb2-bb0d-41a7-9242-baab824f8951 tempest-TestVolumeBackupRestore-300009580 tempest-TestVolumeBackupRestore-300009580-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:25:47.907279 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-48d9efb2-bb0d-41a7-9242-baab824f8951 tempest-TestVolumeBackupRestore-300009580 tempest-TestVolumeBackupRestore-300009580-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:26:30.337170 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.manager [None req-6ca972b5-3515-489a-95e9-8e836d088139 tempest-TestNetworkAdvancedServerOps-325372242 tempest-TestNetworkAdvancedServerOps-325372242-project] Took 0.86 seconds to select destinations for 1 instance(s). {{(pid=98844) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 14:26:30.434739 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-6ca972b5-3515-489a-95e9-8e836d088139 tempest-TestNetworkAdvancedServerOps-325372242 tempest-TestNetworkAdvancedServerOps-325372242-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:26:30.448103 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-6ca972b5-3515-489a-95e9-8e836d088139 tempest-TestNetworkAdvancedServerOps-325372242 tempest-TestNetworkAdvancedServerOps-325372242-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:26:30.624859 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-6ca972b5-3515-489a-95e9-8e836d088139 tempest-TestNetworkAdvancedServerOps-325372242 tempest-TestNetworkAdvancedServerOps-325372242-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:26:30.628633 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-6ca972b5-3515-489a-95e9-8e836d088139 tempest-TestNetworkAdvancedServerOps-325372242 tempest-TestNetworkAdvancedServerOps-325372242-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:26:30.630138 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-6ca972b5-3515-489a-95e9-8e836d088139 tempest-TestNetworkAdvancedServerOps-325372242 tempest-TestNetworkAdvancedServerOps-325372242-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:26:30.631644 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-6ca972b5-3515-489a-95e9-8e836d088139 tempest-TestNetworkAdvancedServerOps-325372242 tempest-TestNetworkAdvancedServerOps-325372242-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:26:30.644962 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-3efd95c7-0fb3-494a-b9e7-6ac4c6304431 tempest-TestServerBasicOps-432268169 tempest-TestServerBasicOps-432268169-project] Took 0.97 seconds to select destinations for 1 instance(s). {{(pid=98843) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 14:26:30.695612 n-d-791503-6 nova-conductor[98844]: DEBUG nova.quota [None req-6ca972b5-3515-489a-95e9-8e836d088139 tempest-TestNetworkAdvancedServerOps-325372242 tempest-TestNetworkAdvancedServerOps-325372242-project] Getting quotas for project 2a60bb13a0574cdab82008527834da62. Resources: {'cores', 'ram', 'instances'} {{(pid=98844) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 14:26:30.702151 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-3efd95c7-0fb3-494a-b9e7-6ac4c6304431 tempest-TestServerBasicOps-432268169 tempest-TestServerBasicOps-432268169-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:26:30.704524 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-3efd95c7-0fb3-494a-b9e7-6ac4c6304431 tempest-TestServerBasicOps-432268169 tempest-TestServerBasicOps-432268169-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:26:30.714166 n-d-791503-6 nova-conductor[98844]: DEBUG nova.quota [None req-6ca972b5-3515-489a-95e9-8e836d088139 tempest-TestNetworkAdvancedServerOps-325372242 tempest-TestNetworkAdvancedServerOps-325372242-project] Getting quotas for user 0c0e5ad3040d4b359c87144f5f35b3e3 and project 2a60bb13a0574cdab82008527834da62. Resources: {'cores', 'ram', 'instances'} {{(pid=98844) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 14:26:30.740681 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.manager [None req-6ca972b5-3515-489a-95e9-8e836d088139 tempest-TestNetworkAdvancedServerOps-325372242 tempest-TestNetworkAdvancedServerOps-325372242-project] [instance: 9be0e53e-519b-4b25-9a09-78c76232d125] Selected host: n-h2-791503-6; Selected node: n-h2-791503-6; Alternates: [('n-h1-791503-6', 'n-h1-791503-6')] {{(pid=98844) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 14:26:30.742001 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-6ca972b5-3515-489a-95e9-8e836d088139 tempest-TestNetworkAdvancedServerOps-325372242 tempest-TestNetworkAdvancedServerOps-325372242-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:26:30.748827 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-6ca972b5-3515-489a-95e9-8e836d088139 tempest-TestNetworkAdvancedServerOps-325372242 tempest-TestNetworkAdvancedServerOps-325372242-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:26:30.765722 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.manager [None req-6ca972b5-3515-489a-95e9-8e836d088139 tempest-TestNetworkAdvancedServerOps-325372242 tempest-TestNetworkAdvancedServerOps-325372242-project] [instance: 9be0e53e-519b-4b25-9a09-78c76232d125] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='64f6036b-99a9-40e4-8963-3cdf66964954',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98844) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 14:26:30.767240 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-6ca972b5-3515-489a-95e9-8e836d088139 tempest-TestNetworkAdvancedServerOps-325372242 tempest-TestNetworkAdvancedServerOps-325372242-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:26:30.767665 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-6ca972b5-3515-489a-95e9-8e836d088139 tempest-TestNetworkAdvancedServerOps-325372242 tempest-TestNetworkAdvancedServerOps-325372242-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:26:30.858565 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-6ca972b5-3515-489a-95e9-8e836d088139 tempest-TestNetworkAdvancedServerOps-325372242 tempest-TestNetworkAdvancedServerOps-325372242-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:26:30.859025 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-6ca972b5-3515-489a-95e9-8e836d088139 tempest-TestNetworkAdvancedServerOps-325372242 tempest-TestNetworkAdvancedServerOps-325372242-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:26:30.871626 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-3efd95c7-0fb3-494a-b9e7-6ac4c6304431 tempest-TestServerBasicOps-432268169 tempest-TestServerBasicOps-432268169-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:26:30.872435 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-3efd95c7-0fb3-494a-b9e7-6ac4c6304431 tempest-TestServerBasicOps-432268169 tempest-TestServerBasicOps-432268169-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:26:30.873745 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-3efd95c7-0fb3-494a-b9e7-6ac4c6304431 tempest-TestServerBasicOps-432268169 tempest-TestServerBasicOps-432268169-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:26:30.874649 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-3efd95c7-0fb3-494a-b9e7-6ac4c6304431 tempest-TestServerBasicOps-432268169 tempest-TestServerBasicOps-432268169-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:26:30.970990 n-d-791503-6 nova-conductor[98843]: DEBUG nova.quota [None req-3efd95c7-0fb3-494a-b9e7-6ac4c6304431 tempest-TestServerBasicOps-432268169 tempest-TestServerBasicOps-432268169-project] Getting quotas for project 89e8af23e5ce4570a01e2789b8be9fa5. Resources: {'cores', 'ram', 'instances'} {{(pid=98843) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 14:26:30.985385 n-d-791503-6 nova-conductor[98843]: DEBUG nova.quota [None req-3efd95c7-0fb3-494a-b9e7-6ac4c6304431 tempest-TestServerBasicOps-432268169 tempest-TestServerBasicOps-432268169-project] Getting quotas for user 07a60250fa674480a5c8f643892499dc and project 89e8af23e5ce4570a01e2789b8be9fa5. Resources: {'cores', 'ram', 'instances'} {{(pid=98843) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 14:26:31.013160 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-3efd95c7-0fb3-494a-b9e7-6ac4c6304431 tempest-TestServerBasicOps-432268169 tempest-TestServerBasicOps-432268169-project] [instance: f639514f-cb82-4486-83d9-7e3028d54d4b] Selected host: n-h2-791503-6; Selected node: n-h2-791503-6; Alternates: [('n-h1-791503-6', 'n-h1-791503-6')] {{(pid=98843) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 14:26:31.021126 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-3efd95c7-0fb3-494a-b9e7-6ac4c6304431 tempest-TestServerBasicOps-432268169 tempest-TestServerBasicOps-432268169-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:26:31.021996 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-3efd95c7-0fb3-494a-b9e7-6ac4c6304431 tempest-TestServerBasicOps-432268169 tempest-TestServerBasicOps-432268169-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:26:31.032480 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-3efd95c7-0fb3-494a-b9e7-6ac4c6304431 tempest-TestServerBasicOps-432268169 tempest-TestServerBasicOps-432268169-project] [instance: f639514f-cb82-4486-83d9-7e3028d54d4b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='64f6036b-99a9-40e4-8963-3cdf66964954',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98843) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 14:26:31.034961 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-3efd95c7-0fb3-494a-b9e7-6ac4c6304431 tempest-TestServerBasicOps-432268169 tempest-TestServerBasicOps-432268169-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:26:31.035915 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-3efd95c7-0fb3-494a-b9e7-6ac4c6304431 tempest-TestServerBasicOps-432268169 tempest-TestServerBasicOps-432268169-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:26:31.110811 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-3efd95c7-0fb3-494a-b9e7-6ac4c6304431 tempest-TestServerBasicOps-432268169 tempest-TestServerBasicOps-432268169-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:26:31.112527 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-3efd95c7-0fb3-494a-b9e7-6ac4c6304431 tempest-TestServerBasicOps-432268169 tempest-TestServerBasicOps-432268169-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:26:42.140664 n-d-791503-6 nova-conductor[98844]: ERROR oslo.messaging._drivers.impl_rabbit [-] [cbd7c90c-b59a-4f8b-992f-d04ba5ad6f9c] AMQP server on 10.222.0.68:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection May 28 14:26:43.170880 n-d-791503-6 nova-conductor[98844]: INFO oslo.messaging._drivers.impl_rabbit [-] [cbd7c90c-b59a-4f8b-992f-d04ba5ad6f9c] Reconnected to AMQP server on 10.222.0.68:5672 via [amqp] client with port 48830. May 28 14:26:44.348640 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.manager [None req-f47a09fd-68fc-4248-9fec-92f3e9f12516 tempest-TestSecurityGroupsBasicOps-1631877101 tempest-TestSecurityGroupsBasicOps-1631877101-project] Took 1.64 seconds to select destinations for 1 instance(s). {{(pid=98844) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 14:26:44.440074 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-f47a09fd-68fc-4248-9fec-92f3e9f12516 tempest-TestSecurityGroupsBasicOps-1631877101 tempest-TestSecurityGroupsBasicOps-1631877101-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:26:44.440736 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-f47a09fd-68fc-4248-9fec-92f3e9f12516 tempest-TestSecurityGroupsBasicOps-1631877101 tempest-TestSecurityGroupsBasicOps-1631877101-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:26:44.618794 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-f47a09fd-68fc-4248-9fec-92f3e9f12516 tempest-TestSecurityGroupsBasicOps-1631877101 tempest-TestSecurityGroupsBasicOps-1631877101-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:26:44.623812 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-f47a09fd-68fc-4248-9fec-92f3e9f12516 tempest-TestSecurityGroupsBasicOps-1631877101 tempest-TestSecurityGroupsBasicOps-1631877101-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:26:44.624920 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-f47a09fd-68fc-4248-9fec-92f3e9f12516 tempest-TestSecurityGroupsBasicOps-1631877101 tempest-TestSecurityGroupsBasicOps-1631877101-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:26:44.625204 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-f47a09fd-68fc-4248-9fec-92f3e9f12516 tempest-TestSecurityGroupsBasicOps-1631877101 tempest-TestSecurityGroupsBasicOps-1631877101-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:26:44.682920 n-d-791503-6 nova-conductor[98844]: DEBUG nova.quota [None req-f47a09fd-68fc-4248-9fec-92f3e9f12516 tempest-TestSecurityGroupsBasicOps-1631877101 tempest-TestSecurityGroupsBasicOps-1631877101-project] Getting quotas for project 0962ce1c4ca94a80a5c265c1978d4e09. Resources: {'cores', 'ram', 'instances'} {{(pid=98844) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 14:26:44.700481 n-d-791503-6 nova-conductor[98844]: DEBUG nova.quota [None req-f47a09fd-68fc-4248-9fec-92f3e9f12516 tempest-TestSecurityGroupsBasicOps-1631877101 tempest-TestSecurityGroupsBasicOps-1631877101-project] Getting quotas for user ce31a2651d7844e9a812e65733d7991f and project 0962ce1c4ca94a80a5c265c1978d4e09. Resources: {'cores', 'ram', 'instances'} {{(pid=98844) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 14:26:44.733991 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.manager [None req-f47a09fd-68fc-4248-9fec-92f3e9f12516 tempest-TestSecurityGroupsBasicOps-1631877101 tempest-TestSecurityGroupsBasicOps-1631877101-project] [instance: 0917882f-bcf2-4b76-96a9-511ea8f3dd22] Selected host: n-h1-791503-6; Selected node: n-h1-791503-6; Alternates: [] {{(pid=98844) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 14:26:44.735111 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-f47a09fd-68fc-4248-9fec-92f3e9f12516 tempest-TestSecurityGroupsBasicOps-1631877101 tempest-TestSecurityGroupsBasicOps-1631877101-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:26:44.735531 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-f47a09fd-68fc-4248-9fec-92f3e9f12516 tempest-TestSecurityGroupsBasicOps-1631877101 tempest-TestSecurityGroupsBasicOps-1631877101-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:26:44.772826 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.manager [None req-f47a09fd-68fc-4248-9fec-92f3e9f12516 tempest-TestSecurityGroupsBasicOps-1631877101 tempest-TestSecurityGroupsBasicOps-1631877101-project] [instance: 0917882f-bcf2-4b76-96a9-511ea8f3dd22] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='64f6036b-99a9-40e4-8963-3cdf66964954',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98844) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 14:26:44.774704 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-f47a09fd-68fc-4248-9fec-92f3e9f12516 tempest-TestSecurityGroupsBasicOps-1631877101 tempest-TestSecurityGroupsBasicOps-1631877101-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:26:44.776545 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-f47a09fd-68fc-4248-9fec-92f3e9f12516 tempest-TestSecurityGroupsBasicOps-1631877101 tempest-TestSecurityGroupsBasicOps-1631877101-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:26:44.847331 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-f47a09fd-68fc-4248-9fec-92f3e9f12516 tempest-TestSecurityGroupsBasicOps-1631877101 tempest-TestSecurityGroupsBasicOps-1631877101-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:26:44.880552 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-f47a09fd-68fc-4248-9fec-92f3e9f12516 tempest-TestSecurityGroupsBasicOps-1631877101 tempest-TestSecurityGroupsBasicOps-1631877101-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:33.558674 n-d-791503-6 nova-conductor[98843]: ERROR oslo.messaging._drivers.impl_rabbit [-] [fb67aa64-250d-4c34-b696-14a5dd0b49b6] AMQP server on 10.222.0.68:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection May 28 14:27:34.619379 n-d-791503-6 nova-conductor[98843]: INFO oslo.messaging._drivers.impl_rabbit [-] [fb67aa64-250d-4c34-b696-14a5dd0b49b6] Reconnected to AMQP server on 10.222.0.68:5672 via [amqp] client with port 49132. May 28 14:27:45.168418 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-2b4d30f8-9232-40f2-90f2-124f426b80e7 tempest-AttachVolumeShelveTestJSON-973645753 tempest-AttachVolumeShelveTestJSON-973645753-project] Took 0.84 seconds to select destinations for 1 instance(s). {{(pid=98843) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 14:27:45.257477 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-2b4d30f8-9232-40f2-90f2-124f426b80e7 tempest-AttachVolumeShelveTestJSON-973645753 tempest-AttachVolumeShelveTestJSON-973645753-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:45.266173 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-2b4d30f8-9232-40f2-90f2-124f426b80e7 tempest-AttachVolumeShelveTestJSON-973645753 tempest-AttachVolumeShelveTestJSON-973645753-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:45.560456 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-2b4d30f8-9232-40f2-90f2-124f426b80e7 tempest-AttachVolumeShelveTestJSON-973645753 tempest-AttachVolumeShelveTestJSON-973645753-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:45.568363 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-2b4d30f8-9232-40f2-90f2-124f426b80e7 tempest-AttachVolumeShelveTestJSON-973645753 tempest-AttachVolumeShelveTestJSON-973645753-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:45.576526 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-2b4d30f8-9232-40f2-90f2-124f426b80e7 tempest-AttachVolumeShelveTestJSON-973645753 tempest-AttachVolumeShelveTestJSON-973645753-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:45.578699 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-2b4d30f8-9232-40f2-90f2-124f426b80e7 tempest-AttachVolumeShelveTestJSON-973645753 tempest-AttachVolumeShelveTestJSON-973645753-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:45.698750 n-d-791503-6 nova-conductor[98843]: DEBUG nova.quota [None req-2b4d30f8-9232-40f2-90f2-124f426b80e7 tempest-AttachVolumeShelveTestJSON-973645753 tempest-AttachVolumeShelveTestJSON-973645753-project] Getting quotas for project 6c6530b0e8ec428eb1b96f4024d655a9. Resources: {'cores', 'ram', 'instances'} {{(pid=98843) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 14:27:45.722103 n-d-791503-6 nova-conductor[98843]: DEBUG nova.quota [None req-2b4d30f8-9232-40f2-90f2-124f426b80e7 tempest-AttachVolumeShelveTestJSON-973645753 tempest-AttachVolumeShelveTestJSON-973645753-project] Getting quotas for user 27d61c1947944cb29d1eb79d52480a0f and project 6c6530b0e8ec428eb1b96f4024d655a9. Resources: {'cores', 'ram', 'instances'} {{(pid=98843) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 14:27:45.797180 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-2b4d30f8-9232-40f2-90f2-124f426b80e7 tempest-AttachVolumeShelveTestJSON-973645753 tempest-AttachVolumeShelveTestJSON-973645753-project] [instance: cb64dff2-abb5-4b82-aa8d-a78904bf287e] Selected host: n-h1-791503-6; Selected node: n-h1-791503-6; Alternates: [('n-h2-791503-6', 'n-h2-791503-6')] {{(pid=98843) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 14:27:45.798693 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-2b4d30f8-9232-40f2-90f2-124f426b80e7 tempest-AttachVolumeShelveTestJSON-973645753 tempest-AttachVolumeShelveTestJSON-973645753-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:45.799401 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-2b4d30f8-9232-40f2-90f2-124f426b80e7 tempest-AttachVolumeShelveTestJSON-973645753 tempest-AttachVolumeShelveTestJSON-973645753-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:45.834845 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-2b4d30f8-9232-40f2-90f2-124f426b80e7 tempest-AttachVolumeShelveTestJSON-973645753 tempest-AttachVolumeShelveTestJSON-973645753-project] [instance: cb64dff2-abb5-4b82-aa8d-a78904bf287e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='64f6036b-99a9-40e4-8963-3cdf66964954',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98843) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 14:27:45.837976 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-2b4d30f8-9232-40f2-90f2-124f426b80e7 tempest-AttachVolumeShelveTestJSON-973645753 tempest-AttachVolumeShelveTestJSON-973645753-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:45.838633 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-2b4d30f8-9232-40f2-90f2-124f426b80e7 tempest-AttachVolumeShelveTestJSON-973645753 tempest-AttachVolumeShelveTestJSON-973645753-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:27:45.973957 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-2b4d30f8-9232-40f2-90f2-124f426b80e7 tempest-AttachVolumeShelveTestJSON-973645753 tempest-AttachVolumeShelveTestJSON-973645753-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:27:45.975056 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-2b4d30f8-9232-40f2-90f2-124f426b80e7 tempest-AttachVolumeShelveTestJSON-973645753 tempest-AttachVolumeShelveTestJSON-973645753-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:01.575935 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.manager [None req-f412428c-40ef-42fa-b67e-c76d93423ce1 tempest-TestNetworkAdvancedServerOps-360935568 tempest-TestNetworkAdvancedServerOps-360935568-project-admin] Targeting cell b241212c-c279-4fbb-a1e7-b87889287cbf(cell1) for conductor method migrate_server {{(pid=98844) wrapper /opt/stack/nova/nova/conductor/manager.py:91}} May 28 14:28:01.577341 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-f412428c-40ef-42fa-b67e-c76d93423ce1 tempest-TestNetworkAdvancedServerOps-360935568 tempest-TestNetworkAdvancedServerOps-360935568-project-admin] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:28:01.578303 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-f412428c-40ef-42fa-b67e-c76d93423ce1 tempest-TestNetworkAdvancedServerOps-360935568 tempest-TestNetworkAdvancedServerOps-360935568-project-admin] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:28:02.603932 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.tasks.migrate [None req-f412428c-40ef-42fa-b67e-c76d93423ce1 tempest-TestNetworkAdvancedServerOps-360935568 tempest-TestNetworkAdvancedServerOps-360935568-project-admin] Created allocations for migration 5f615255-5d20-47b5-9a2d-01774f74ae5b on 5c5ac110-743a-4b71-a058-d2597ba8e0c9 {{(pid=98844) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} May 28 14:28:03.458127 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.tasks.live_migrate [None req-f412428c-40ef-42fa-b67e-c76d93423ce1 tempest-TestNetworkAdvancedServerOps-360935568 tempest-TestNetworkAdvancedServerOps-360935568-project-admin] [instance: 9be0e53e-519b-4b25-9a09-78c76232d125] Requesting cell b241212c-c279-4fbb-a1e7-b87889287cbf(cell1) while live migrating {{(pid=98844) _get_request_spec_for_select_destinations /opt/stack/nova/nova/conductor/tasks/live_migrate.py:494}} May 28 14:28:04.005431 n-d-791503-6 nova-conductor[98844]: DEBUG nova.objects.instance [None req-f412428c-40ef-42fa-b67e-c76d93423ce1 tempest-TestNetworkAdvancedServerOps-360935568 tempest-TestNetworkAdvancedServerOps-360935568-project-admin] Lazy-loading 'resources' on Instance uuid 9be0e53e-519b-4b25-9a09-78c76232d125 {{(pid=98844) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 28 14:28:04.017502 n-d-791503-6 nova-conductor[98844]: DEBUG nova.objects.instance [None req-f412428c-40ef-42fa-b67e-c76d93423ce1 tempest-TestNetworkAdvancedServerOps-360935568 tempest-TestNetworkAdvancedServerOps-360935568-project-admin] Lazy-loading 'pci_requests' on Instance uuid 9be0e53e-519b-4b25-9a09-78c76232d125 {{(pid=98844) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 28 14:28:04.597356 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.tasks.live_migrate [None req-f412428c-40ef-42fa-b67e-c76d93423ce1 tempest-TestNetworkAdvancedServerOps-360935568 tempest-TestNetworkAdvancedServerOps-360935568-project-admin] [instance: 9be0e53e-519b-4b25-9a09-78c76232d125] Start binding ports on destination host: n-h1-791503-6 {{(pid=98844) _bind_ports_on_destination /opt/stack/nova/nova/conductor/tasks/live_migrate.py:389}} May 28 14:28:05.603830 n-d-791503-6 nova-conductor[98843]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 14:28:36.295648 n-d-791503-6 nova-conductor[98844]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 14:29:28.935972 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-8fc80419-5ab8-47b9-9c92-8b9110f85adc tempest-TestNetworkAdvancedServerOps-325372242 tempest-TestNetworkAdvancedServerOps-325372242-project] Took 0.63 seconds to select destinations for 1 instance(s). {{(pid=98843) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 14:29:29.023958 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-8fc80419-5ab8-47b9-9c92-8b9110f85adc tempest-TestNetworkAdvancedServerOps-325372242 tempest-TestNetworkAdvancedServerOps-325372242-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:29:29.031466 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-8fc80419-5ab8-47b9-9c92-8b9110f85adc tempest-TestNetworkAdvancedServerOps-325372242 tempest-TestNetworkAdvancedServerOps-325372242-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:29:29.130079 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-8fc80419-5ab8-47b9-9c92-8b9110f85adc tempest-TestNetworkAdvancedServerOps-325372242 tempest-TestNetworkAdvancedServerOps-325372242-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:29:29.131249 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-8fc80419-5ab8-47b9-9c92-8b9110f85adc tempest-TestNetworkAdvancedServerOps-325372242 tempest-TestNetworkAdvancedServerOps-325372242-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:29:29.132818 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-8fc80419-5ab8-47b9-9c92-8b9110f85adc tempest-TestNetworkAdvancedServerOps-325372242 tempest-TestNetworkAdvancedServerOps-325372242-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:29:29.133767 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-8fc80419-5ab8-47b9-9c92-8b9110f85adc tempest-TestNetworkAdvancedServerOps-325372242 tempest-TestNetworkAdvancedServerOps-325372242-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:29:29.182840 n-d-791503-6 nova-conductor[98843]: DEBUG nova.quota [None req-8fc80419-5ab8-47b9-9c92-8b9110f85adc tempest-TestNetworkAdvancedServerOps-325372242 tempest-TestNetworkAdvancedServerOps-325372242-project] Getting quotas for project 2a60bb13a0574cdab82008527834da62. Resources: {'cores', 'ram', 'instances'} {{(pid=98843) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 14:29:29.193533 n-d-791503-6 nova-conductor[98843]: DEBUG nova.quota [None req-8fc80419-5ab8-47b9-9c92-8b9110f85adc tempest-TestNetworkAdvancedServerOps-325372242 tempest-TestNetworkAdvancedServerOps-325372242-project] Getting quotas for user 0c0e5ad3040d4b359c87144f5f35b3e3 and project 2a60bb13a0574cdab82008527834da62. Resources: {'cores', 'ram', 'instances'} {{(pid=98843) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 14:29:29.212477 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-8fc80419-5ab8-47b9-9c92-8b9110f85adc tempest-TestNetworkAdvancedServerOps-325372242 tempest-TestNetworkAdvancedServerOps-325372242-project] [instance: 8a2e289d-5034-41e8-8459-d0b68d7e0c8e] Selected host: n-h2-791503-6; Selected node: n-h2-791503-6; Alternates: [('n-h1-791503-6', 'n-h1-791503-6')] {{(pid=98843) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 14:29:29.225285 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-8fc80419-5ab8-47b9-9c92-8b9110f85adc tempest-TestNetworkAdvancedServerOps-325372242 tempest-TestNetworkAdvancedServerOps-325372242-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:29:29.226411 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-8fc80419-5ab8-47b9-9c92-8b9110f85adc tempest-TestNetworkAdvancedServerOps-325372242 tempest-TestNetworkAdvancedServerOps-325372242-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:29:29.237953 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-8fc80419-5ab8-47b9-9c92-8b9110f85adc tempest-TestNetworkAdvancedServerOps-325372242 tempest-TestNetworkAdvancedServerOps-325372242-project] [instance: 8a2e289d-5034-41e8-8459-d0b68d7e0c8e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='64f6036b-99a9-40e4-8963-3cdf66964954',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98843) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 14:29:29.240933 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-8fc80419-5ab8-47b9-9c92-8b9110f85adc tempest-TestNetworkAdvancedServerOps-325372242 tempest-TestNetworkAdvancedServerOps-325372242-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:29:29.241898 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-8fc80419-5ab8-47b9-9c92-8b9110f85adc tempest-TestNetworkAdvancedServerOps-325372242 tempest-TestNetworkAdvancedServerOps-325372242-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:29:29.313598 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-8fc80419-5ab8-47b9-9c92-8b9110f85adc tempest-TestNetworkAdvancedServerOps-325372242 tempest-TestNetworkAdvancedServerOps-325372242-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:29:29.315524 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-8fc80419-5ab8-47b9-9c92-8b9110f85adc tempest-TestNetworkAdvancedServerOps-325372242 tempest-TestNetworkAdvancedServerOps-325372242-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:30:18.528085 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.manager [None req-a409e1ce-992d-4817-97df-00a422bc4de7 tempest-TestNetworkAdvancedServerOps-325372242 tempest-TestNetworkAdvancedServerOps-325372242-project] Targeting cell b241212c-c279-4fbb-a1e7-b87889287cbf(cell1) for conductor method rebuild_instance {{(pid=98844) wrapper /opt/stack/nova/nova/conductor/manager.py:91}} May 28 14:30:18.531467 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-a409e1ce-992d-4817-97df-00a422bc4de7 tempest-TestNetworkAdvancedServerOps-325372242 tempest-TestNetworkAdvancedServerOps-325372242-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:30:18.532424 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-a409e1ce-992d-4817-97df-00a422bc4de7 tempest-TestNetworkAdvancedServerOps-325372242 tempest-TestNetworkAdvancedServerOps-325372242-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:30:18.594498 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.manager [None req-a409e1ce-992d-4817-97df-00a422bc4de7 tempest-TestNetworkAdvancedServerOps-325372242 tempest-TestNetworkAdvancedServerOps-325372242-project] [instance: 8a2e289d-5034-41e8-8459-d0b68d7e0c8e] No migration record for the rebuild/evacuate request. {{(pid=98844) rebuild_instance /opt/stack/nova/nova/conductor/manager.py:1101}} May 28 14:30:34.615470 n-d-791503-6 nova-conductor[98843]: ERROR oslo.messaging._drivers.impl_rabbit [-] [fb67aa64-250d-4c34-b696-14a5dd0b49b6] AMQP server on 10.222.0.68:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection May 28 14:30:35.655635 n-d-791503-6 nova-conductor[98843]: INFO oslo.messaging._drivers.impl_rabbit [-] [fb67aa64-250d-4c34-b696-14a5dd0b49b6] Reconnected to AMQP server on 10.222.0.68:5672 via [amqp] client with port 50816. May 28 14:30:43.173129 n-d-791503-6 nova-conductor[98844]: ERROR oslo.messaging._drivers.impl_rabbit [-] [cbd7c90c-b59a-4f8b-992f-d04ba5ad6f9c] AMQP server on 10.222.0.68:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 28 14:30:44.200202 n-d-791503-6 nova-conductor[98844]: INFO oslo.messaging._drivers.impl_rabbit [-] [cbd7c90c-b59a-4f8b-992f-d04ba5ad6f9c] Reconnected to AMQP server on 10.222.0.68:5672 via [amqp] client with port 50874. May 28 14:30:45.275687 n-d-791503-6 nova-conductor[98844]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 14:30:47.229231 n-d-791503-6 nova-conductor[98844]: ERROR oslo.messaging._drivers.impl_rabbit [-] [abccac45-5c00-4182-bcd1-fb6828b957ad] AMQP server on 10.222.0.68:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 28 14:30:48.265358 n-d-791503-6 nova-conductor[98844]: INFO oslo.messaging._drivers.impl_rabbit [-] [abccac45-5c00-4182-bcd1-fb6828b957ad] Reconnected to AMQP server on 10.222.0.68:5672 via [amqp] client with port 50976. May 28 14:31:12.358621 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-ac824bbc-a4dd-4408-a63e-242fef799a49 tempest-VolumesActionsTest-725221948 tempest-VolumesActionsTest-725221948-project] Took 0.62 seconds to select destinations for 1 instance(s). {{(pid=98843) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 14:31:12.386060 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-ac824bbc-a4dd-4408-a63e-242fef799a49 tempest-VolumesActionsTest-725221948 tempest-VolumesActionsTest-725221948-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:31:12.386610 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-ac824bbc-a4dd-4408-a63e-242fef799a49 tempest-VolumesActionsTest-725221948 tempest-VolumesActionsTest-725221948-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:31:12.449967 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-ac824bbc-a4dd-4408-a63e-242fef799a49 tempest-VolumesActionsTest-725221948 tempest-VolumesActionsTest-725221948-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:31:12.450388 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-ac824bbc-a4dd-4408-a63e-242fef799a49 tempest-VolumesActionsTest-725221948 tempest-VolumesActionsTest-725221948-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:31:12.451170 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-ac824bbc-a4dd-4408-a63e-242fef799a49 tempest-VolumesActionsTest-725221948 tempest-VolumesActionsTest-725221948-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:31:12.451567 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-ac824bbc-a4dd-4408-a63e-242fef799a49 tempest-VolumesActionsTest-725221948 tempest-VolumesActionsTest-725221948-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:31:12.471667 n-d-791503-6 nova-conductor[98843]: DEBUG nova.quota [None req-ac824bbc-a4dd-4408-a63e-242fef799a49 tempest-VolumesActionsTest-725221948 tempest-VolumesActionsTest-725221948-project] Getting quotas for project 874ebfd961be49f787b135318528c997. Resources: {'cores', 'ram', 'instances'} {{(pid=98843) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 14:31:12.476900 n-d-791503-6 nova-conductor[98843]: DEBUG nova.quota [None req-ac824bbc-a4dd-4408-a63e-242fef799a49 tempest-VolumesActionsTest-725221948 tempest-VolumesActionsTest-725221948-project] Getting quotas for user 452c483235ba4c019d82ff492b04b914 and project 874ebfd961be49f787b135318528c997. Resources: {'cores', 'ram', 'instances'} {{(pid=98843) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 14:31:12.490456 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-ac824bbc-a4dd-4408-a63e-242fef799a49 tempest-VolumesActionsTest-725221948 tempest-VolumesActionsTest-725221948-project] [instance: ebfd03f9-457d-4b2b-8187-a89fe046bbce] Selected host: n-h1-791503-6; Selected node: n-h1-791503-6; Alternates: [('n-h2-791503-6', 'n-h2-791503-6')] {{(pid=98843) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 14:31:12.491476 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-ac824bbc-a4dd-4408-a63e-242fef799a49 tempest-VolumesActionsTest-725221948 tempest-VolumesActionsTest-725221948-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:31:12.491874 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-ac824bbc-a4dd-4408-a63e-242fef799a49 tempest-VolumesActionsTest-725221948 tempest-VolumesActionsTest-725221948-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:31:12.499756 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-ac824bbc-a4dd-4408-a63e-242fef799a49 tempest-VolumesActionsTest-725221948 tempest-VolumesActionsTest-725221948-project] [instance: ebfd03f9-457d-4b2b-8187-a89fe046bbce] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='64f6036b-99a9-40e4-8963-3cdf66964954',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98843) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 14:31:12.501028 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-ac824bbc-a4dd-4408-a63e-242fef799a49 tempest-VolumesActionsTest-725221948 tempest-VolumesActionsTest-725221948-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:31:12.501485 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-ac824bbc-a4dd-4408-a63e-242fef799a49 tempest-VolumesActionsTest-725221948 tempest-VolumesActionsTest-725221948-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:31:12.542682 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-ac824bbc-a4dd-4408-a63e-242fef799a49 tempest-VolumesActionsTest-725221948 tempest-VolumesActionsTest-725221948-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:31:12.543521 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-ac824bbc-a4dd-4408-a63e-242fef799a49 tempest-VolumesActionsTest-725221948 tempest-VolumesActionsTest-725221948-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:31:25.639549 n-d-791503-6 nova-conductor[98843]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 14:31:46.700859 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.manager [None req-822267f7-30da-4587-ba39-6de3b4d9e6f5 tempest-AttachVolumeShelveTestJSON-973645753 tempest-AttachVolumeShelveTestJSON-973645753-project] Targeting cell b241212c-c279-4fbb-a1e7-b87889287cbf(cell1) for conductor method unshelve_instance {{(pid=98844) wrapper /opt/stack/nova/nova/conductor/manager.py:91}} May 28 14:31:46.701735 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-822267f7-30da-4587-ba39-6de3b4d9e6f5 tempest-AttachVolumeShelveTestJSON-973645753 tempest-AttachVolumeShelveTestJSON-973645753-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:31:46.701871 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-822267f7-30da-4587-ba39-6de3b4d9e6f5 tempest-AttachVolumeShelveTestJSON-973645753 tempest-AttachVolumeShelveTestJSON-973645753-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:31:47.511565 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.manager [None req-822267f7-30da-4587-ba39-6de3b4d9e6f5 tempest-AttachVolumeShelveTestJSON-973645753 tempest-AttachVolumeShelveTestJSON-973645753-project] [instance: cb64dff2-abb5-4b82-aa8d-a78904bf287e] Requesting cell b241212c-c279-4fbb-a1e7-b87889287cbf(cell1) during scheduling {{(pid=98844) _restrict_request_spec_to_cell /opt/stack/nova/nova/conductor/manager.py:902}} May 28 14:31:48.225808 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.manager [None req-822267f7-30da-4587-ba39-6de3b4d9e6f5 tempest-AttachVolumeShelveTestJSON-973645753 tempest-AttachVolumeShelveTestJSON-973645753-project] Took 0.71 seconds to select destinations for 1 instance(s). {{(pid=98844) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 14:31:48.237327 n-d-791503-6 nova-conductor[98844]: DEBUG nova.objects.instance [None req-822267f7-30da-4587-ba39-6de3b4d9e6f5 tempest-AttachVolumeShelveTestJSON-973645753 tempest-AttachVolumeShelveTestJSON-973645753-project] Lazy-loading 'flavor' on Instance uuid cb64dff2-abb5-4b82-aa8d-a78904bf287e {{(pid=98844) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 28 14:32:16.752175 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-d00adcbf-893b-4547-bc21-fac9dea033e5 tempest-VolumesBackupsTest-271968890 tempest-VolumesBackupsTest-271968890-project] Took 0.36 seconds to select destinations for 1 instance(s). {{(pid=98843) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 14:32:16.785536 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-d00adcbf-893b-4547-bc21-fac9dea033e5 tempest-VolumesBackupsTest-271968890 tempest-VolumesBackupsTest-271968890-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:32:16.786204 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-d00adcbf-893b-4547-bc21-fac9dea033e5 tempest-VolumesBackupsTest-271968890 tempest-VolumesBackupsTest-271968890-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:32:16.855965 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-d00adcbf-893b-4547-bc21-fac9dea033e5 tempest-VolumesBackupsTest-271968890 tempest-VolumesBackupsTest-271968890-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:32:16.856558 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-d00adcbf-893b-4547-bc21-fac9dea033e5 tempest-VolumesBackupsTest-271968890 tempest-VolumesBackupsTest-271968890-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:32:16.857472 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-d00adcbf-893b-4547-bc21-fac9dea033e5 tempest-VolumesBackupsTest-271968890 tempest-VolumesBackupsTest-271968890-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:32:16.857963 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-d00adcbf-893b-4547-bc21-fac9dea033e5 tempest-VolumesBackupsTest-271968890 tempest-VolumesBackupsTest-271968890-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:32:16.878697 n-d-791503-6 nova-conductor[98843]: DEBUG nova.quota [None req-d00adcbf-893b-4547-bc21-fac9dea033e5 tempest-VolumesBackupsTest-271968890 tempest-VolumesBackupsTest-271968890-project] Getting quotas for project dfa8d702729742b5874df5ffa1aacb37. Resources: {'cores', 'ram', 'instances'} {{(pid=98843) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 14:32:16.884301 n-d-791503-6 nova-conductor[98843]: DEBUG nova.quota [None req-d00adcbf-893b-4547-bc21-fac9dea033e5 tempest-VolumesBackupsTest-271968890 tempest-VolumesBackupsTest-271968890-project] Getting quotas for user 0cfa00f720284fcc9ccc688681ffa39b and project dfa8d702729742b5874df5ffa1aacb37. Resources: {'cores', 'ram', 'instances'} {{(pid=98843) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 14:32:16.896740 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-d00adcbf-893b-4547-bc21-fac9dea033e5 tempest-VolumesBackupsTest-271968890 tempest-VolumesBackupsTest-271968890-project] [instance: ffb3fd47-5a94-42c6-a52e-4df5e246c873] Selected host: n-h2-791503-6; Selected node: n-h2-791503-6; Alternates: [('n-h1-791503-6', 'n-h1-791503-6')] {{(pid=98843) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 14:32:16.897707 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-d00adcbf-893b-4547-bc21-fac9dea033e5 tempest-VolumesBackupsTest-271968890 tempest-VolumesBackupsTest-271968890-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:32:16.898102 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-d00adcbf-893b-4547-bc21-fac9dea033e5 tempest-VolumesBackupsTest-271968890 tempest-VolumesBackupsTest-271968890-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:32:16.909774 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-d00adcbf-893b-4547-bc21-fac9dea033e5 tempest-VolumesBackupsTest-271968890 tempest-VolumesBackupsTest-271968890-project] [instance: ffb3fd47-5a94-42c6-a52e-4df5e246c873] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='64f6036b-99a9-40e4-8963-3cdf66964954',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98843) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 14:32:16.912164 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-d00adcbf-893b-4547-bc21-fac9dea033e5 tempest-VolumesBackupsTest-271968890 tempest-VolumesBackupsTest-271968890-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:32:16.912692 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-d00adcbf-893b-4547-bc21-fac9dea033e5 tempest-VolumesBackupsTest-271968890 tempest-VolumesBackupsTest-271968890-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:32:16.966797 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-d00adcbf-893b-4547-bc21-fac9dea033e5 tempest-VolumesBackupsTest-271968890 tempest-VolumesBackupsTest-271968890-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:32:16.967301 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-d00adcbf-893b-4547-bc21-fac9dea033e5 tempest-VolumesBackupsTest-271968890 tempest-VolumesBackupsTest-271968890-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:33:35.655781 n-d-791503-6 nova-conductor[98843]: ERROR oslo.messaging._drivers.impl_rabbit [-] [fb67aa64-250d-4c34-b696-14a5dd0b49b6] AMQP server on 10.222.0.68:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection May 28 14:33:36.343115 n-d-791503-6 nova-conductor[98844]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 14:33:36.675490 n-d-791503-6 nova-conductor[98843]: INFO oslo.messaging._drivers.impl_rabbit [-] [fb67aa64-250d-4c34-b696-14a5dd0b49b6] Reconnected to AMQP server on 10.222.0.68:5672 via [amqp] client with port 53266. May 28 14:33:44.199809 n-d-791503-6 nova-conductor[98844]: ERROR oslo.messaging._drivers.impl_rabbit [-] [cbd7c90c-b59a-4f8b-992f-d04ba5ad6f9c] AMQP server on 10.222.0.68:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 28 14:33:45.217657 n-d-791503-6 nova-conductor[98844]: INFO oslo.messaging._drivers.impl_rabbit [-] [cbd7c90c-b59a-4f8b-992f-d04ba5ad6f9c] Reconnected to AMQP server on 10.222.0.68:5672 via [amqp] client with port 53340. May 28 14:33:47.577759 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.manager [None req-6ccc9668-a313-499a-ae92-003a4d698786 tempest-AttachVolumeShelveTestJSON-973645753 tempest-AttachVolumeShelveTestJSON-973645753-project] Took 0.26 seconds to select destinations for 1 instance(s). {{(pid=98844) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 14:33:47.605827 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-6ccc9668-a313-499a-ae92-003a4d698786 tempest-AttachVolumeShelveTestJSON-973645753 tempest-AttachVolumeShelveTestJSON-973645753-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:33:47.606406 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-6ccc9668-a313-499a-ae92-003a4d698786 tempest-AttachVolumeShelveTestJSON-973645753 tempest-AttachVolumeShelveTestJSON-973645753-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:33:47.684166 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-6ccc9668-a313-499a-ae92-003a4d698786 tempest-AttachVolumeShelveTestJSON-973645753 tempest-AttachVolumeShelveTestJSON-973645753-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:33:47.684576 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-6ccc9668-a313-499a-ae92-003a4d698786 tempest-AttachVolumeShelveTestJSON-973645753 tempest-AttachVolumeShelveTestJSON-973645753-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:33:47.688504 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-6ccc9668-a313-499a-ae92-003a4d698786 tempest-AttachVolumeShelveTestJSON-973645753 tempest-AttachVolumeShelveTestJSON-973645753-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:33:47.689004 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-6ccc9668-a313-499a-ae92-003a4d698786 tempest-AttachVolumeShelveTestJSON-973645753 tempest-AttachVolumeShelveTestJSON-973645753-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:33:47.713524 n-d-791503-6 nova-conductor[98844]: DEBUG nova.quota [None req-6ccc9668-a313-499a-ae92-003a4d698786 tempest-AttachVolumeShelveTestJSON-973645753 tempest-AttachVolumeShelveTestJSON-973645753-project] Getting quotas for project 6c6530b0e8ec428eb1b96f4024d655a9. Resources: {'cores', 'ram', 'instances'} {{(pid=98844) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 14:33:47.719892 n-d-791503-6 nova-conductor[98844]: DEBUG nova.quota [None req-6ccc9668-a313-499a-ae92-003a4d698786 tempest-AttachVolumeShelveTestJSON-973645753 tempest-AttachVolumeShelveTestJSON-973645753-project] Getting quotas for user 27d61c1947944cb29d1eb79d52480a0f and project 6c6530b0e8ec428eb1b96f4024d655a9. Resources: {'cores', 'ram', 'instances'} {{(pid=98844) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 14:33:47.730592 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.manager [None req-6ccc9668-a313-499a-ae92-003a4d698786 tempest-AttachVolumeShelveTestJSON-973645753 tempest-AttachVolumeShelveTestJSON-973645753-project] [instance: d418f9b8-625e-4367-923d-70a34f6dccba] Selected host: n-h1-791503-6; Selected node: n-h1-791503-6; Alternates: [('n-h2-791503-6', 'n-h2-791503-6')] {{(pid=98844) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 14:33:47.732660 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-6ccc9668-a313-499a-ae92-003a4d698786 tempest-AttachVolumeShelveTestJSON-973645753 tempest-AttachVolumeShelveTestJSON-973645753-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:33:47.734325 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-6ccc9668-a313-499a-ae92-003a4d698786 tempest-AttachVolumeShelveTestJSON-973645753 tempest-AttachVolumeShelveTestJSON-973645753-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:33:47.743981 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.manager [None req-6ccc9668-a313-499a-ae92-003a4d698786 tempest-AttachVolumeShelveTestJSON-973645753 tempest-AttachVolumeShelveTestJSON-973645753-project] [instance: d418f9b8-625e-4367-923d-70a34f6dccba] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='64f6036b-99a9-40e4-8963-3cdf66964954',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98844) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 14:33:47.747901 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-6ccc9668-a313-499a-ae92-003a4d698786 tempest-AttachVolumeShelveTestJSON-973645753 tempest-AttachVolumeShelveTestJSON-973645753-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:33:47.747901 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-6ccc9668-a313-499a-ae92-003a4d698786 tempest-AttachVolumeShelveTestJSON-973645753 tempest-AttachVolumeShelveTestJSON-973645753-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:33:47.784569 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-6ccc9668-a313-499a-ae92-003a4d698786 tempest-AttachVolumeShelveTestJSON-973645753 tempest-AttachVolumeShelveTestJSON-973645753-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:33:47.784985 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-6ccc9668-a313-499a-ae92-003a4d698786 tempest-AttachVolumeShelveTestJSON-973645753 tempest-AttachVolumeShelveTestJSON-973645753-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:34:25.932291 n-d-791503-6 nova-conductor[98843]: ERROR oslo.messaging._drivers.impl_rabbit [-] [eee199a3-5934-45a4-999a-298f0a81318b] AMQP server on 10.222.0.68:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 28 14:34:26.954867 n-d-791503-6 nova-conductor[98843]: INFO oslo.messaging._drivers.impl_rabbit [-] [eee199a3-5934-45a4-999a-298f0a81318b] Reconnected to AMQP server on 10.222.0.68:5672 via [amqp] client with port 53738. May 28 14:34:45.693109 n-d-791503-6 nova-conductor[98843]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 14:34:47.450718 n-d-791503-6 nova-conductor[98843]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4bc4adbd-2091-473e-8e44-b9a43f01ab64] AMQP server on 10.222.0.68:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 28 14:34:48.469639 n-d-791503-6 nova-conductor[98843]: INFO oslo.messaging._drivers.impl_rabbit [-] [4bc4adbd-2091-473e-8e44-b9a43f01ab64] Reconnected to AMQP server on 10.222.0.68:5672 via [amqp] client with port 53920. May 28 14:35:47.877388 n-d-791503-6 nova-conductor[98844]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 14:35:48.268700 n-d-791503-6 nova-conductor[98844]: ERROR oslo.messaging._drivers.impl_rabbit [-] [abccac45-5c00-4182-bcd1-fb6828b957ad] AMQP server on 10.222.0.68:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 28 14:35:49.289738 n-d-791503-6 nova-conductor[98844]: INFO oslo.messaging._drivers.impl_rabbit [-] [abccac45-5c00-4182-bcd1-fb6828b957ad] Reconnected to AMQP server on 10.222.0.68:5672 via [amqp] client with port 55068. May 28 14:36:28.045977 n-d-791503-6 nova-conductor[98844]: ERROR oslo.messaging._drivers.impl_rabbit [-] [8840711a-c4c2-4555-9645-ce157ee9cc0d] AMQP server on 10.222.0.68:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 28 14:36:29.091993 n-d-791503-6 nova-conductor[98844]: INFO oslo.messaging._drivers.impl_rabbit [-] [8840711a-c4c2-4555-9645-ce157ee9cc0d] Reconnected to AMQP server on 10.222.0.68:5672 via [amqp] client with port 55664. May 28 14:36:36.674998 n-d-791503-6 nova-conductor[98843]: ERROR oslo.messaging._drivers.impl_rabbit [-] [fb67aa64-250d-4c34-b696-14a5dd0b49b6] AMQP server on 10.222.0.68:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection May 28 14:36:37.692406 n-d-791503-6 nova-conductor[98843]: INFO oslo.messaging._drivers.impl_rabbit [-] [fb67aa64-250d-4c34-b696-14a5dd0b49b6] Reconnected to AMQP server on 10.222.0.68:5672 via [amqp] client with port 55866. May 28 14:36:45.217829 n-d-791503-6 nova-conductor[98844]: ERROR oslo.messaging._drivers.impl_rabbit [-] [cbd7c90c-b59a-4f8b-992f-d04ba5ad6f9c] AMQP server on 10.222.0.68:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 28 14:36:46.235906 n-d-791503-6 nova-conductor[98844]: INFO oslo.messaging._drivers.impl_rabbit [-] [cbd7c90c-b59a-4f8b-992f-d04ba5ad6f9c] Reconnected to AMQP server on 10.222.0.68:5672 via [amqp] client with port 55982. May 28 14:36:56.361369 n-d-791503-6 nova-conductor[98844]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 14:37:06.953640 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-f957e36b-72da-4e93-b71a-ad66de88c257 tempest-AttachVolumeShelveTestJSON-973645753 tempest-AttachVolumeShelveTestJSON-973645753-project] Targeting cell b241212c-c279-4fbb-a1e7-b87889287cbf(cell1) for conductor method unshelve_instance {{(pid=98843) wrapper /opt/stack/nova/nova/conductor/manager.py:91}} May 28 14:37:06.954737 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-f957e36b-72da-4e93-b71a-ad66de88c257 tempest-AttachVolumeShelveTestJSON-973645753 tempest-AttachVolumeShelveTestJSON-973645753-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:37:06.955229 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-f957e36b-72da-4e93-b71a-ad66de88c257 tempest-AttachVolumeShelveTestJSON-973645753 tempest-AttachVolumeShelveTestJSON-973645753-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:37:07.441381 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-f957e36b-72da-4e93-b71a-ad66de88c257 tempest-AttachVolumeShelveTestJSON-973645753 tempest-AttachVolumeShelveTestJSON-973645753-project] [instance: d418f9b8-625e-4367-923d-70a34f6dccba] Requesting cell b241212c-c279-4fbb-a1e7-b87889287cbf(cell1) during scheduling {{(pid=98843) _restrict_request_spec_to_cell /opt/stack/nova/nova/conductor/manager.py:902}} May 28 14:37:07.452048 n-d-791503-6 nova-conductor[98843]: ERROR oslo.messaging._drivers.impl_rabbit [None req-f957e36b-72da-4e93-b71a-ad66de88c257 tempest-AttachVolumeShelveTestJSON-973645753 tempest-AttachVolumeShelveTestJSON-973645753-project] [bdcda531-d598-424e-8dcd-ab215e26c83b] AMQP server on 10.222.0.68:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 28 14:37:08.468985 n-d-791503-6 nova-conductor[98843]: INFO oslo.messaging._drivers.impl_rabbit [None req-f957e36b-72da-4e93-b71a-ad66de88c257 tempest-AttachVolumeShelveTestJSON-973645753 tempest-AttachVolumeShelveTestJSON-973645753-project] [bdcda531-d598-424e-8dcd-ab215e26c83b] Reconnected to AMQP server on 10.222.0.68:5672 via [amqp] client with port 56672. May 28 14:37:10.946436 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-f957e36b-72da-4e93-b71a-ad66de88c257 tempest-AttachVolumeShelveTestJSON-973645753 tempest-AttachVolumeShelveTestJSON-973645753-project] Took 3.50 seconds to select destinations for 1 instance(s). {{(pid=98843) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 14:37:10.965209 n-d-791503-6 nova-conductor[98843]: DEBUG nova.objects.instance [None req-f957e36b-72da-4e93-b71a-ad66de88c257 tempest-AttachVolumeShelveTestJSON-973645753 tempest-AttachVolumeShelveTestJSON-973645753-project] Lazy-loading 'flavor' on Instance uuid d418f9b8-625e-4367-923d-70a34f6dccba {{(pid=98843) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 28 14:37:11.046652 n-d-791503-6 nova-conductor[98843]: ERROR oslo.messaging._drivers.impl_rabbit [None req-f957e36b-72da-4e93-b71a-ad66de88c257 tempest-AttachVolumeShelveTestJSON-973645753 tempest-AttachVolumeShelveTestJSON-973645753-project] [9282344d-1714-453f-af6a-f153528668cb] AMQP server on 10.222.0.68:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 28 14:37:12.064862 n-d-791503-6 nova-conductor[98843]: INFO oslo.messaging._drivers.impl_rabbit [None req-f957e36b-72da-4e93-b71a-ad66de88c257 tempest-AttachVolumeShelveTestJSON-973645753 tempest-AttachVolumeShelveTestJSON-973645753-project] [9282344d-1714-453f-af6a-f153528668cb] Reconnected to AMQP server on 10.222.0.68:5672 via [amqp] client with port 56698. May 28 14:37:18.957034 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.manager [None req-bade0181-b459-429e-a486-707898141533 tempest-TestNetworkBasicOps-578149500 tempest-TestNetworkBasicOps-578149500-project] Took 0.46 seconds to select destinations for 1 instance(s). {{(pid=98844) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 14:37:18.984084 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-bade0181-b459-429e-a486-707898141533 tempest-TestNetworkBasicOps-578149500 tempest-TestNetworkBasicOps-578149500-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:37:18.984553 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-bade0181-b459-429e-a486-707898141533 tempest-TestNetworkBasicOps-578149500 tempest-TestNetworkBasicOps-578149500-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:37:19.044115 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-bade0181-b459-429e-a486-707898141533 tempest-TestNetworkBasicOps-578149500 tempest-TestNetworkBasicOps-578149500-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:37:19.044615 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-bade0181-b459-429e-a486-707898141533 tempest-TestNetworkBasicOps-578149500 tempest-TestNetworkBasicOps-578149500-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:37:19.045382 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-bade0181-b459-429e-a486-707898141533 tempest-TestNetworkBasicOps-578149500 tempest-TestNetworkBasicOps-578149500-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:37:19.045771 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-bade0181-b459-429e-a486-707898141533 tempest-TestNetworkBasicOps-578149500 tempest-TestNetworkBasicOps-578149500-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:37:19.069579 n-d-791503-6 nova-conductor[98844]: DEBUG nova.quota [None req-bade0181-b459-429e-a486-707898141533 tempest-TestNetworkBasicOps-578149500 tempest-TestNetworkBasicOps-578149500-project] Getting quotas for project 02064a5953f14ca1bc406caa05b6e299. Resources: {'cores', 'ram', 'instances'} {{(pid=98844) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 14:37:19.075977 n-d-791503-6 nova-conductor[98844]: DEBUG nova.quota [None req-bade0181-b459-429e-a486-707898141533 tempest-TestNetworkBasicOps-578149500 tempest-TestNetworkBasicOps-578149500-project] Getting quotas for user 4225d564f39c41dfb8e9e3d7cc4d6ada and project 02064a5953f14ca1bc406caa05b6e299. Resources: {'cores', 'ram', 'instances'} {{(pid=98844) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 14:37:19.088582 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.manager [None req-bade0181-b459-429e-a486-707898141533 tempest-TestNetworkBasicOps-578149500 tempest-TestNetworkBasicOps-578149500-project] [instance: b630c4b0-a7b6-46fe-b509-f679a507377f] Selected host: n-h1-791503-6; Selected node: n-h1-791503-6; Alternates: [('n-h2-791503-6', 'n-h2-791503-6')] {{(pid=98844) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 14:37:19.089823 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-bade0181-b459-429e-a486-707898141533 tempest-TestNetworkBasicOps-578149500 tempest-TestNetworkBasicOps-578149500-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:37:19.090427 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-bade0181-b459-429e-a486-707898141533 tempest-TestNetworkBasicOps-578149500 tempest-TestNetworkBasicOps-578149500-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:37:19.098677 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.manager [None req-bade0181-b459-429e-a486-707898141533 tempest-TestNetworkBasicOps-578149500 tempest-TestNetworkBasicOps-578149500-project] [instance: b630c4b0-a7b6-46fe-b509-f679a507377f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='64f6036b-99a9-40e4-8963-3cdf66964954',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98844) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 14:37:19.101100 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-bade0181-b459-429e-a486-707898141533 tempest-TestNetworkBasicOps-578149500 tempest-TestNetworkBasicOps-578149500-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:37:19.101727 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-bade0181-b459-429e-a486-707898141533 tempest-TestNetworkBasicOps-578149500 tempest-TestNetworkBasicOps-578149500-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:37:19.146900 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-bade0181-b459-429e-a486-707898141533 tempest-TestNetworkBasicOps-578149500 tempest-TestNetworkBasicOps-578149500-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:37:19.147600 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-bade0181-b459-429e-a486-707898141533 tempest-TestNetworkBasicOps-578149500 tempest-TestNetworkBasicOps-578149500-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:38:05.716232 n-d-791503-6 nova-conductor[98843]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 14:38:53.952694 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-19e9f5a4-ff80-46d2-b7b3-5c08c9d1db5a tempest-TestNetworkBasicOps-578149500 tempest-TestNetworkBasicOps-578149500-project] Took 0.24 seconds to select destinations for 1 instance(s). {{(pid=98843) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 14:38:53.992055 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-19e9f5a4-ff80-46d2-b7b3-5c08c9d1db5a tempest-TestNetworkBasicOps-578149500 tempest-TestNetworkBasicOps-578149500-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:38:53.992867 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-19e9f5a4-ff80-46d2-b7b3-5c08c9d1db5a tempest-TestNetworkBasicOps-578149500 tempest-TestNetworkBasicOps-578149500-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:38:54.050797 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-19e9f5a4-ff80-46d2-b7b3-5c08c9d1db5a tempest-TestNetworkBasicOps-578149500 tempest-TestNetworkBasicOps-578149500-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:38:54.051230 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-19e9f5a4-ff80-46d2-b7b3-5c08c9d1db5a tempest-TestNetworkBasicOps-578149500 tempest-TestNetworkBasicOps-578149500-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:38:54.051955 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-19e9f5a4-ff80-46d2-b7b3-5c08c9d1db5a tempest-TestNetworkBasicOps-578149500 tempest-TestNetworkBasicOps-578149500-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:38:54.052338 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-19e9f5a4-ff80-46d2-b7b3-5c08c9d1db5a tempest-TestNetworkBasicOps-578149500 tempest-TestNetworkBasicOps-578149500-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:38:54.073914 n-d-791503-6 nova-conductor[98843]: DEBUG nova.quota [None req-19e9f5a4-ff80-46d2-b7b3-5c08c9d1db5a tempest-TestNetworkBasicOps-578149500 tempest-TestNetworkBasicOps-578149500-project] Getting quotas for project 02064a5953f14ca1bc406caa05b6e299. Resources: {'cores', 'ram', 'instances'} {{(pid=98843) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 14:38:54.078856 n-d-791503-6 nova-conductor[98843]: DEBUG nova.quota [None req-19e9f5a4-ff80-46d2-b7b3-5c08c9d1db5a tempest-TestNetworkBasicOps-578149500 tempest-TestNetworkBasicOps-578149500-project] Getting quotas for user 4225d564f39c41dfb8e9e3d7cc4d6ada and project 02064a5953f14ca1bc406caa05b6e299. Resources: {'cores', 'ram', 'instances'} {{(pid=98843) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 14:38:54.089848 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-19e9f5a4-ff80-46d2-b7b3-5c08c9d1db5a tempest-TestNetworkBasicOps-578149500 tempest-TestNetworkBasicOps-578149500-project] [instance: b92b37e9-aadb-4b90-a886-fd017bb49af7] Selected host: n-h2-791503-6; Selected node: n-h2-791503-6; Alternates: [('n-h1-791503-6', 'n-h1-791503-6')] {{(pid=98843) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 14:38:54.090814 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-19e9f5a4-ff80-46d2-b7b3-5c08c9d1db5a tempest-TestNetworkBasicOps-578149500 tempest-TestNetworkBasicOps-578149500-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:38:54.091284 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-19e9f5a4-ff80-46d2-b7b3-5c08c9d1db5a tempest-TestNetworkBasicOps-578149500 tempest-TestNetworkBasicOps-578149500-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:38:54.098333 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-19e9f5a4-ff80-46d2-b7b3-5c08c9d1db5a tempest-TestNetworkBasicOps-578149500 tempest-TestNetworkBasicOps-578149500-project] [instance: b92b37e9-aadb-4b90-a886-fd017bb49af7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='64f6036b-99a9-40e4-8963-3cdf66964954',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98843) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 14:38:54.099696 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-19e9f5a4-ff80-46d2-b7b3-5c08c9d1db5a tempest-TestNetworkBasicOps-578149500 tempest-TestNetworkBasicOps-578149500-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:38:54.100100 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-19e9f5a4-ff80-46d2-b7b3-5c08c9d1db5a tempest-TestNetworkBasicOps-578149500 tempest-TestNetworkBasicOps-578149500-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:38:54.131597 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-19e9f5a4-ff80-46d2-b7b3-5c08c9d1db5a tempest-TestNetworkBasicOps-578149500 tempest-TestNetworkBasicOps-578149500-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:38:54.131995 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-19e9f5a4-ff80-46d2-b7b3-5c08c9d1db5a tempest-TestNetworkBasicOps-578149500 tempest-TestNetworkBasicOps-578149500-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:39:29.072024 n-d-791503-6 nova-conductor[98844]: ERROR oslo.messaging._drivers.impl_rabbit [-] [8840711a-c4c2-4555-9645-ce157ee9cc0d] AMQP server on 10.222.0.68:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 28 14:39:30.096547 n-d-791503-6 nova-conductor[98844]: INFO oslo.messaging._drivers.impl_rabbit [-] [8840711a-c4c2-4555-9645-ce157ee9cc0d] Reconnected to AMQP server on 10.222.0.68:5672 via [amqp] client with port 58376. May 28 14:39:37.693753 n-d-791503-6 nova-conductor[98843]: ERROR oslo.messaging._drivers.impl_rabbit [-] [fb67aa64-250d-4c34-b696-14a5dd0b49b6] AMQP server on 10.222.0.68:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection May 28 14:39:38.715463 n-d-791503-6 nova-conductor[98843]: INFO oslo.messaging._drivers.impl_rabbit [-] [fb67aa64-250d-4c34-b696-14a5dd0b49b6] Reconnected to AMQP server on 10.222.0.68:5672 via [amqp] client with port 58506. May 28 14:39:46.235544 n-d-791503-6 nova-conductor[98844]: ERROR oslo.messaging._drivers.impl_rabbit [-] [cbd7c90c-b59a-4f8b-992f-d04ba5ad6f9c] AMQP server on 10.222.0.68:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection May 28 14:39:47.256693 n-d-791503-6 nova-conductor[98844]: INFO oslo.messaging._drivers.impl_rabbit [-] [cbd7c90c-b59a-4f8b-992f-d04ba5ad6f9c] Reconnected to AMQP server on 10.222.0.68:5672 via [amqp] client with port 58590. May 28 14:39:49.299683 n-d-791503-6 nova-conductor[98844]: ERROR oslo.messaging._drivers.impl_rabbit [-] [abccac45-5c00-4182-bcd1-fb6828b957ad] AMQP server on 10.222.0.68:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 28 14:39:50.338776 n-d-791503-6 nova-conductor[98844]: INFO oslo.messaging._drivers.impl_rabbit [-] [abccac45-5c00-4182-bcd1-fb6828b957ad] Reconnected to AMQP server on 10.222.0.68:5672 via [amqp] client with port 58600. May 28 14:40:09.696711 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-e93303c8-2b9e-4718-a76c-887fa1416ade tempest-TestNetworkBasicOps-578149500 tempest-TestNetworkBasicOps-578149500-project] Took 0.22 seconds to select destinations for 1 instance(s). {{(pid=98843) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 14:40:09.722270 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-e93303c8-2b9e-4718-a76c-887fa1416ade tempest-TestNetworkBasicOps-578149500 tempest-TestNetworkBasicOps-578149500-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:40:09.722668 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-e93303c8-2b9e-4718-a76c-887fa1416ade tempest-TestNetworkBasicOps-578149500 tempest-TestNetworkBasicOps-578149500-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:40:09.770240 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-e93303c8-2b9e-4718-a76c-887fa1416ade tempest-TestNetworkBasicOps-578149500 tempest-TestNetworkBasicOps-578149500-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:40:09.773313 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-e93303c8-2b9e-4718-a76c-887fa1416ade tempest-TestNetworkBasicOps-578149500 tempest-TestNetworkBasicOps-578149500-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:40:09.773313 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-e93303c8-2b9e-4718-a76c-887fa1416ade tempest-TestNetworkBasicOps-578149500 tempest-TestNetworkBasicOps-578149500-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:40:09.773313 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-e93303c8-2b9e-4718-a76c-887fa1416ade tempest-TestNetworkBasicOps-578149500 tempest-TestNetworkBasicOps-578149500-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:40:09.794672 n-d-791503-6 nova-conductor[98843]: DEBUG nova.quota [None req-e93303c8-2b9e-4718-a76c-887fa1416ade tempest-TestNetworkBasicOps-578149500 tempest-TestNetworkBasicOps-578149500-project] Getting quotas for project 02064a5953f14ca1bc406caa05b6e299. Resources: {'cores', 'ram', 'instances'} {{(pid=98843) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 14:40:09.799822 n-d-791503-6 nova-conductor[98843]: DEBUG nova.quota [None req-e93303c8-2b9e-4718-a76c-887fa1416ade tempest-TestNetworkBasicOps-578149500 tempest-TestNetworkBasicOps-578149500-project] Getting quotas for user 4225d564f39c41dfb8e9e3d7cc4d6ada and project 02064a5953f14ca1bc406caa05b6e299. Resources: {'cores', 'ram', 'instances'} {{(pid=98843) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 14:40:09.811676 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-e93303c8-2b9e-4718-a76c-887fa1416ade tempest-TestNetworkBasicOps-578149500 tempest-TestNetworkBasicOps-578149500-project] [instance: 434ab06d-58d8-4054-a1af-424923f05d8f] Selected host: n-h1-791503-6; Selected node: n-h1-791503-6; Alternates: [('n-h2-791503-6', 'n-h2-791503-6')] {{(pid=98843) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 14:40:09.812930 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-e93303c8-2b9e-4718-a76c-887fa1416ade tempest-TestNetworkBasicOps-578149500 tempest-TestNetworkBasicOps-578149500-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:40:09.813494 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-e93303c8-2b9e-4718-a76c-887fa1416ade tempest-TestNetworkBasicOps-578149500 tempest-TestNetworkBasicOps-578149500-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:40:09.820877 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-e93303c8-2b9e-4718-a76c-887fa1416ade tempest-TestNetworkBasicOps-578149500 tempest-TestNetworkBasicOps-578149500-project] [instance: 434ab06d-58d8-4054-a1af-424923f05d8f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='64f6036b-99a9-40e4-8963-3cdf66964954',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98843) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 14:40:09.822203 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-e93303c8-2b9e-4718-a76c-887fa1416ade tempest-TestNetworkBasicOps-578149500 tempest-TestNetworkBasicOps-578149500-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:40:09.822581 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-e93303c8-2b9e-4718-a76c-887fa1416ade tempest-TestNetworkBasicOps-578149500 tempest-TestNetworkBasicOps-578149500-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:40:09.851767 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-e93303c8-2b9e-4718-a76c-887fa1416ade tempest-TestNetworkBasicOps-578149500 tempest-TestNetworkBasicOps-578149500-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:40:09.852169 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-e93303c8-2b9e-4718-a76c-887fa1416ade tempest-TestNetworkBasicOps-578149500 tempest-TestNetworkBasicOps-578149500-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:40:16.383331 n-d-791503-6 nova-conductor[98844]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 14:41:25.743821 n-d-791503-6 nova-conductor[98843]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 14:42:10.286442 n-d-791503-6 nova-conductor[98844]: ERROR oslo.messaging._drivers.impl_rabbit [None req-6ee73152-3bb4-41ed-afc5-decff9844eca tempest-TestServerMultinode-1023859542 tempest-TestServerMultinode-1023859542-project-admin] [3a6b43b2-a32b-4c5b-93cc-103fb16cb905] AMQP server on 10.222.0.68:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 28 14:42:11.303507 n-d-791503-6 nova-conductor[98844]: INFO oslo.messaging._drivers.impl_rabbit [None req-6ee73152-3bb4-41ed-afc5-decff9844eca tempest-TestServerMultinode-1023859542 tempest-TestServerMultinode-1023859542-project-admin] [3a6b43b2-a32b-4c5b-93cc-103fb16cb905] Reconnected to AMQP server on 10.222.0.68:5672 via [amqp] client with port 59984. May 28 14:42:13.576484 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.manager [None req-6ee73152-3bb4-41ed-afc5-decff9844eca tempest-TestServerMultinode-1023859542 tempest-TestServerMultinode-1023859542-project-admin] Took 3.30 seconds to select destinations for 1 instance(s). {{(pid=98844) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 14:42:13.600042 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-6ee73152-3bb4-41ed-afc5-decff9844eca tempest-TestServerMultinode-1023859542 tempest-TestServerMultinode-1023859542-project-admin] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:42:13.600451 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-6ee73152-3bb4-41ed-afc5-decff9844eca tempest-TestServerMultinode-1023859542 tempest-TestServerMultinode-1023859542-project-admin] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:42:13.664298 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-6ee73152-3bb4-41ed-afc5-decff9844eca tempest-TestServerMultinode-1023859542 tempest-TestServerMultinode-1023859542-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:42:13.664708 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-6ee73152-3bb4-41ed-afc5-decff9844eca tempest-TestServerMultinode-1023859542 tempest-TestServerMultinode-1023859542-project-admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:42:13.665473 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-6ee73152-3bb4-41ed-afc5-decff9844eca tempest-TestServerMultinode-1023859542 tempest-TestServerMultinode-1023859542-project-admin] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:42:13.665899 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-6ee73152-3bb4-41ed-afc5-decff9844eca tempest-TestServerMultinode-1023859542 tempest-TestServerMultinode-1023859542-project-admin] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:42:13.684175 n-d-791503-6 nova-conductor[98844]: DEBUG nova.quota [None req-6ee73152-3bb4-41ed-afc5-decff9844eca tempest-TestServerMultinode-1023859542 tempest-TestServerMultinode-1023859542-project-admin] Getting quotas for project 3cb6d0fbe85544f0bc0fc3b4a24d7bfd. Resources: {'cores', 'ram', 'instances'} {{(pid=98844) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 14:42:13.689356 n-d-791503-6 nova-conductor[98844]: DEBUG nova.quota [None req-6ee73152-3bb4-41ed-afc5-decff9844eca tempest-TestServerMultinode-1023859542 tempest-TestServerMultinode-1023859542-project-admin] Getting quotas for user 53b303b5b94d4d9a902e98b8ce17c565 and project 3cb6d0fbe85544f0bc0fc3b4a24d7bfd. Resources: {'cores', 'ram', 'instances'} {{(pid=98844) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 14:42:13.700928 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.manager [None req-6ee73152-3bb4-41ed-afc5-decff9844eca tempest-TestServerMultinode-1023859542 tempest-TestServerMultinode-1023859542-project-admin] [instance: 6624d096-3157-47d4-ba6d-23ab40e19f91] Selected host: n-h2-791503-6; Selected node: n-h2-791503-6; Alternates: [] {{(pid=98844) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 14:42:13.701815 n-d-791503-6 nova-conductor[98844]: DEBUG nova.scheduler.utils [None req-6ee73152-3bb4-41ed-afc5-decff9844eca tempest-TestServerMultinode-1023859542 tempest-TestServerMultinode-1023859542-project-admin] Re-scheduling is disabled due to forcing a host (['n-h2-791503-6']) and/or node ([]) {{(pid=98844) populate_retry /opt/stack/nova/nova/scheduler/utils.py:951}} May 28 14:42:13.702937 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-6ee73152-3bb4-41ed-afc5-decff9844eca tempest-TestServerMultinode-1023859542 tempest-TestServerMultinode-1023859542-project-admin] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:42:13.703510 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-6ee73152-3bb4-41ed-afc5-decff9844eca tempest-TestServerMultinode-1023859542 tempest-TestServerMultinode-1023859542-project-admin] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:42:13.711100 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.manager [None req-6ee73152-3bb4-41ed-afc5-decff9844eca tempest-TestServerMultinode-1023859542 tempest-TestServerMultinode-1023859542-project-admin] [instance: 6624d096-3157-47d4-ba6d-23ab40e19f91] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='64f6036b-99a9-40e4-8963-3cdf66964954',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98844) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 14:42:13.712355 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-6ee73152-3bb4-41ed-afc5-decff9844eca tempest-TestServerMultinode-1023859542 tempest-TestServerMultinode-1023859542-project-admin] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:42:13.712758 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-6ee73152-3bb4-41ed-afc5-decff9844eca tempest-TestServerMultinode-1023859542 tempest-TestServerMultinode-1023859542-project-admin] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:42:13.747049 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-6ee73152-3bb4-41ed-afc5-decff9844eca tempest-TestServerMultinode-1023859542 tempest-TestServerMultinode-1023859542-project-admin] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:42:13.747425 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-6ee73152-3bb4-41ed-afc5-decff9844eca tempest-TestServerMultinode-1023859542 tempest-TestServerMultinode-1023859542-project-admin] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:42:13.756623 n-d-791503-6 nova-conductor[98844]: ERROR oslo.messaging._drivers.impl_rabbit [None req-6ee73152-3bb4-41ed-afc5-decff9844eca tempest-TestServerMultinode-1023859542 tempest-TestServerMultinode-1023859542-project-admin] [44592b86-ea23-4a40-8b73-bb4398a5e365] AMQP server on 10.222.0.68:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 28 14:42:14.772728 n-d-791503-6 nova-conductor[98844]: INFO oslo.messaging._drivers.impl_rabbit [None req-6ee73152-3bb4-41ed-afc5-decff9844eca tempest-TestServerMultinode-1023859542 tempest-TestServerMultinode-1023859542-project-admin] [44592b86-ea23-4a40-8b73-bb4398a5e365] Reconnected to AMQP server on 10.222.0.68:5672 via [amqp] client with port 60006. May 28 14:42:25.543259 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-5982f079-fea5-41c4-92fb-75cac79ccc48 tempest-TestServerMultinode-1023859542 tempest-TestServerMultinode-1023859542-project-admin] Took 0.36 seconds to select destinations for 1 instance(s). {{(pid=98843) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 14:42:25.567648 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-5982f079-fea5-41c4-92fb-75cac79ccc48 tempest-TestServerMultinode-1023859542 tempest-TestServerMultinode-1023859542-project-admin] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:42:25.568044 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-5982f079-fea5-41c4-92fb-75cac79ccc48 tempest-TestServerMultinode-1023859542 tempest-TestServerMultinode-1023859542-project-admin] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:42:25.613447 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-5982f079-fea5-41c4-92fb-75cac79ccc48 tempest-TestServerMultinode-1023859542 tempest-TestServerMultinode-1023859542-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:42:25.613842 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-5982f079-fea5-41c4-92fb-75cac79ccc48 tempest-TestServerMultinode-1023859542 tempest-TestServerMultinode-1023859542-project-admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:42:25.614637 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-5982f079-fea5-41c4-92fb-75cac79ccc48 tempest-TestServerMultinode-1023859542 tempest-TestServerMultinode-1023859542-project-admin] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:42:25.615045 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-5982f079-fea5-41c4-92fb-75cac79ccc48 tempest-TestServerMultinode-1023859542 tempest-TestServerMultinode-1023859542-project-admin] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:42:25.634102 n-d-791503-6 nova-conductor[98843]: DEBUG nova.quota [None req-5982f079-fea5-41c4-92fb-75cac79ccc48 tempest-TestServerMultinode-1023859542 tempest-TestServerMultinode-1023859542-project-admin] Getting quotas for project 3cb6d0fbe85544f0bc0fc3b4a24d7bfd. Resources: {'cores', 'ram', 'instances'} {{(pid=98843) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 14:42:25.638670 n-d-791503-6 nova-conductor[98843]: DEBUG nova.quota [None req-5982f079-fea5-41c4-92fb-75cac79ccc48 tempest-TestServerMultinode-1023859542 tempest-TestServerMultinode-1023859542-project-admin] Getting quotas for user 53b303b5b94d4d9a902e98b8ce17c565 and project 3cb6d0fbe85544f0bc0fc3b4a24d7bfd. Resources: {'cores', 'ram', 'instances'} {{(pid=98843) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 14:42:25.651411 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-5982f079-fea5-41c4-92fb-75cac79ccc48 tempest-TestServerMultinode-1023859542 tempest-TestServerMultinode-1023859542-project-admin] [instance: bbdbbc84-4790-4cbe-ad9a-7f59ebaa4dcc] Selected host: n-h1-791503-6; Selected node: n-h1-791503-6; Alternates: [] {{(pid=98843) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 14:42:25.651411 n-d-791503-6 nova-conductor[98843]: DEBUG nova.scheduler.utils [None req-5982f079-fea5-41c4-92fb-75cac79ccc48 tempest-TestServerMultinode-1023859542 tempest-TestServerMultinode-1023859542-project-admin] Re-scheduling is disabled due to forcing a host (['n-h1-791503-6']) and/or node ([]) {{(pid=98843) populate_retry /opt/stack/nova/nova/scheduler/utils.py:951}} May 28 14:42:25.651411 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-5982f079-fea5-41c4-92fb-75cac79ccc48 tempest-TestServerMultinode-1023859542 tempest-TestServerMultinode-1023859542-project-admin] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:42:25.651805 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-5982f079-fea5-41c4-92fb-75cac79ccc48 tempest-TestServerMultinode-1023859542 tempest-TestServerMultinode-1023859542-project-admin] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:42:25.660097 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-5982f079-fea5-41c4-92fb-75cac79ccc48 tempest-TestServerMultinode-1023859542 tempest-TestServerMultinode-1023859542-project-admin] [instance: bbdbbc84-4790-4cbe-ad9a-7f59ebaa4dcc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='64f6036b-99a9-40e4-8963-3cdf66964954',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98843) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 14:42:25.661649 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-5982f079-fea5-41c4-92fb-75cac79ccc48 tempest-TestServerMultinode-1023859542 tempest-TestServerMultinode-1023859542-project-admin] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:42:25.662042 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-5982f079-fea5-41c4-92fb-75cac79ccc48 tempest-TestServerMultinode-1023859542 tempest-TestServerMultinode-1023859542-project-admin] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:42:25.695562 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-5982f079-fea5-41c4-92fb-75cac79ccc48 tempest-TestServerMultinode-1023859542 tempest-TestServerMultinode-1023859542-project-admin] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:42:25.695882 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-5982f079-fea5-41c4-92fb-75cac79ccc48 tempest-TestServerMultinode-1023859542 tempest-TestServerMultinode-1023859542-project-admin] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:42:25.705197 n-d-791503-6 nova-conductor[98843]: ERROR oslo.messaging._drivers.impl_rabbit [None req-5982f079-fea5-41c4-92fb-75cac79ccc48 tempest-TestServerMultinode-1023859542 tempest-TestServerMultinode-1023859542-project-admin] [9282344d-1714-453f-af6a-f153528668cb] AMQP server on 10.222.0.68:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 28 14:42:26.720815 n-d-791503-6 nova-conductor[98843]: INFO oslo.messaging._drivers.impl_rabbit [None req-5982f079-fea5-41c4-92fb-75cac79ccc48 tempest-TestServerMultinode-1023859542 tempest-TestServerMultinode-1023859542-project-admin] [9282344d-1714-453f-af6a-f153528668cb] Reconnected to AMQP server on 10.222.0.68:5672 via [amqp] client with port 60074. May 28 14:42:38.712990 n-d-791503-6 nova-conductor[98843]: ERROR oslo.messaging._drivers.impl_rabbit [-] [fb67aa64-250d-4c34-b696-14a5dd0b49b6] AMQP server on 10.222.0.68:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection May 28 14:42:39.729929 n-d-791503-6 nova-conductor[98843]: INFO oslo.messaging._drivers.impl_rabbit [-] [fb67aa64-250d-4c34-b696-14a5dd0b49b6] Reconnected to AMQP server on 10.222.0.68:5672 via [amqp] client with port 60106. May 28 14:42:47.256807 n-d-791503-6 nova-conductor[98844]: ERROR oslo.messaging._drivers.impl_rabbit [-] [cbd7c90c-b59a-4f8b-992f-d04ba5ad6f9c] AMQP server on 10.222.0.68:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 28 14:42:48.274109 n-d-791503-6 nova-conductor[98844]: INFO oslo.messaging._drivers.impl_rabbit [-] [cbd7c90c-b59a-4f8b-992f-d04ba5ad6f9c] Reconnected to AMQP server on 10.222.0.68:5672 via [amqp] client with port 60140. May 28 14:43:10.627863 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.manager [None req-56872802-392d-4e6b-b7a3-4e8af373b756 tempest-ServersAdminNegativeTestJSON-1350593601 tempest-ServersAdminNegativeTestJSON-1350593601-project] Took 0.39 seconds to select destinations for 1 instance(s). {{(pid=98844) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 14:43:10.649423 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-56872802-392d-4e6b-b7a3-4e8af373b756 tempest-ServersAdminNegativeTestJSON-1350593601 tempest-ServersAdminNegativeTestJSON-1350593601-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:43:10.649829 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-56872802-392d-4e6b-b7a3-4e8af373b756 tempest-ServersAdminNegativeTestJSON-1350593601 tempest-ServersAdminNegativeTestJSON-1350593601-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:43:10.699969 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-56872802-392d-4e6b-b7a3-4e8af373b756 tempest-ServersAdminNegativeTestJSON-1350593601 tempest-ServersAdminNegativeTestJSON-1350593601-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:43:10.700286 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-56872802-392d-4e6b-b7a3-4e8af373b756 tempest-ServersAdminNegativeTestJSON-1350593601 tempest-ServersAdminNegativeTestJSON-1350593601-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:43:10.700997 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-56872802-392d-4e6b-b7a3-4e8af373b756 tempest-ServersAdminNegativeTestJSON-1350593601 tempest-ServersAdminNegativeTestJSON-1350593601-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:43:10.701384 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-56872802-392d-4e6b-b7a3-4e8af373b756 tempest-ServersAdminNegativeTestJSON-1350593601 tempest-ServersAdminNegativeTestJSON-1350593601-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:43:10.716382 n-d-791503-6 nova-conductor[98844]: DEBUG nova.quota [None req-56872802-392d-4e6b-b7a3-4e8af373b756 tempest-ServersAdminNegativeTestJSON-1350593601 tempest-ServersAdminNegativeTestJSON-1350593601-project] Getting quotas for project 913a7b42487a40839b88d74ec47c2d73. Resources: {'cores', 'ram', 'instances'} {{(pid=98844) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 14:43:10.721252 n-d-791503-6 nova-conductor[98844]: DEBUG nova.quota [None req-56872802-392d-4e6b-b7a3-4e8af373b756 tempest-ServersAdminNegativeTestJSON-1350593601 tempest-ServersAdminNegativeTestJSON-1350593601-project] Getting quotas for user 9556a9b572a34dde848b4dd757e9bee3 and project 913a7b42487a40839b88d74ec47c2d73. Resources: {'cores', 'ram', 'instances'} {{(pid=98844) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 14:43:10.731580 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.manager [None req-56872802-392d-4e6b-b7a3-4e8af373b756 tempest-ServersAdminNegativeTestJSON-1350593601 tempest-ServersAdminNegativeTestJSON-1350593601-project] [instance: 040dd666-62e6-4a7b-a39d-0056016c2fa9] Selected host: n-h1-791503-6; Selected node: n-h1-791503-6; Alternates: [('n-h2-791503-6', 'n-h2-791503-6')] {{(pid=98844) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 14:43:10.732518 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-56872802-392d-4e6b-b7a3-4e8af373b756 tempest-ServersAdminNegativeTestJSON-1350593601 tempest-ServersAdminNegativeTestJSON-1350593601-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:43:10.732914 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-56872802-392d-4e6b-b7a3-4e8af373b756 tempest-ServersAdminNegativeTestJSON-1350593601 tempest-ServersAdminNegativeTestJSON-1350593601-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:43:10.739651 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.manager [None req-56872802-392d-4e6b-b7a3-4e8af373b756 tempest-ServersAdminNegativeTestJSON-1350593601 tempest-ServersAdminNegativeTestJSON-1350593601-project] [instance: 040dd666-62e6-4a7b-a39d-0056016c2fa9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='64f6036b-99a9-40e4-8963-3cdf66964954',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98844) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 14:43:10.741193 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-56872802-392d-4e6b-b7a3-4e8af373b756 tempest-ServersAdminNegativeTestJSON-1350593601 tempest-ServersAdminNegativeTestJSON-1350593601-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:43:10.741352 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-56872802-392d-4e6b-b7a3-4e8af373b756 tempest-ServersAdminNegativeTestJSON-1350593601 tempest-ServersAdminNegativeTestJSON-1350593601-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:43:10.768527 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-56872802-392d-4e6b-b7a3-4e8af373b756 tempest-ServersAdminNegativeTestJSON-1350593601 tempest-ServersAdminNegativeTestJSON-1350593601-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:43:10.768938 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-56872802-392d-4e6b-b7a3-4e8af373b756 tempest-ServersAdminNegativeTestJSON-1350593601 tempest-ServersAdminNegativeTestJSON-1350593601-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:43:32.421422 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-b43c6466-c21e-46ba-9458-09324fc33ba0 tempest-DeleteServersTestJSON-1804090497 tempest-DeleteServersTestJSON-1804090497-project] Took 0.22 seconds to select destinations for 1 instance(s). {{(pid=98843) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 14:43:32.443728 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-b43c6466-c21e-46ba-9458-09324fc33ba0 tempest-DeleteServersTestJSON-1804090497 tempest-DeleteServersTestJSON-1804090497-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:43:32.444134 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-b43c6466-c21e-46ba-9458-09324fc33ba0 tempest-DeleteServersTestJSON-1804090497 tempest-DeleteServersTestJSON-1804090497-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:43:32.492776 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-b43c6466-c21e-46ba-9458-09324fc33ba0 tempest-DeleteServersTestJSON-1804090497 tempest-DeleteServersTestJSON-1804090497-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:43:32.493194 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-b43c6466-c21e-46ba-9458-09324fc33ba0 tempest-DeleteServersTestJSON-1804090497 tempest-DeleteServersTestJSON-1804090497-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:43:32.493896 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-b43c6466-c21e-46ba-9458-09324fc33ba0 tempest-DeleteServersTestJSON-1804090497 tempest-DeleteServersTestJSON-1804090497-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:43:32.494286 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-b43c6466-c21e-46ba-9458-09324fc33ba0 tempest-DeleteServersTestJSON-1804090497 tempest-DeleteServersTestJSON-1804090497-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:43:32.509359 n-d-791503-6 nova-conductor[98843]: DEBUG nova.quota [None req-b43c6466-c21e-46ba-9458-09324fc33ba0 tempest-DeleteServersTestJSON-1804090497 tempest-DeleteServersTestJSON-1804090497-project] Getting quotas for project 740a7547c9a142b68873f7d764d3001f. Resources: {'cores', 'ram', 'instances'} {{(pid=98843) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 14:43:32.513808 n-d-791503-6 nova-conductor[98843]: DEBUG nova.quota [None req-b43c6466-c21e-46ba-9458-09324fc33ba0 tempest-DeleteServersTestJSON-1804090497 tempest-DeleteServersTestJSON-1804090497-project] Getting quotas for user 7d2ecebcd23647c79aee44dcba849695 and project 740a7547c9a142b68873f7d764d3001f. Resources: {'cores', 'ram', 'instances'} {{(pid=98843) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 14:43:32.524107 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-b43c6466-c21e-46ba-9458-09324fc33ba0 tempest-DeleteServersTestJSON-1804090497 tempest-DeleteServersTestJSON-1804090497-project] [instance: a6fbfe2a-36a2-4873-803d-4fe695f23ea1] Selected host: n-h1-791503-6; Selected node: n-h1-791503-6; Alternates: [('n-h2-791503-6', 'n-h2-791503-6')] {{(pid=98843) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 14:43:32.525037 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-b43c6466-c21e-46ba-9458-09324fc33ba0 tempest-DeleteServersTestJSON-1804090497 tempest-DeleteServersTestJSON-1804090497-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:43:32.525433 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-b43c6466-c21e-46ba-9458-09324fc33ba0 tempest-DeleteServersTestJSON-1804090497 tempest-DeleteServersTestJSON-1804090497-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:43:32.532419 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-b43c6466-c21e-46ba-9458-09324fc33ba0 tempest-DeleteServersTestJSON-1804090497 tempest-DeleteServersTestJSON-1804090497-project] [instance: a6fbfe2a-36a2-4873-803d-4fe695f23ea1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='64f6036b-99a9-40e4-8963-3cdf66964954',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98843) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 14:43:32.533581 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-b43c6466-c21e-46ba-9458-09324fc33ba0 tempest-DeleteServersTestJSON-1804090497 tempest-DeleteServersTestJSON-1804090497-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:43:32.533977 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-b43c6466-c21e-46ba-9458-09324fc33ba0 tempest-DeleteServersTestJSON-1804090497 tempest-DeleteServersTestJSON-1804090497-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:43:32.560869 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-b43c6466-c21e-46ba-9458-09324fc33ba0 tempest-DeleteServersTestJSON-1804090497 tempest-DeleteServersTestJSON-1804090497-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:43:32.561272 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-b43c6466-c21e-46ba-9458-09324fc33ba0 tempest-DeleteServersTestJSON-1804090497 tempest-DeleteServersTestJSON-1804090497-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:43:36.405942 n-d-791503-6 nova-conductor[98844]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 14:43:44.077590 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.manager [None req-ef18b9b2-6ded-4b00-ab8a-ceaf67f1ce2c tempest-DeleteServersTestJSON-1804090497 tempest-DeleteServersTestJSON-1804090497-project] Targeting cell b241212c-c279-4fbb-a1e7-b87889287cbf(cell1) for conductor method migrate_server {{(pid=98844) wrapper /opt/stack/nova/nova/conductor/manager.py:91}} May 28 14:43:44.078701 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-ef18b9b2-6ded-4b00-ab8a-ceaf67f1ce2c tempest-DeleteServersTestJSON-1804090497 tempest-DeleteServersTestJSON-1804090497-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:43:44.078960 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-ef18b9b2-6ded-4b00-ab8a-ceaf67f1ce2c tempest-DeleteServersTestJSON-1804090497 tempest-DeleteServersTestJSON-1804090497-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:43:44.405849 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.tasks.migrate [None req-ef18b9b2-6ded-4b00-ab8a-ceaf67f1ce2c tempest-DeleteServersTestJSON-1804090497 tempest-DeleteServersTestJSON-1804090497-project] [instance: a6fbfe2a-36a2-4873-803d-4fe695f23ea1] Restricting to cell b241212c-c279-4fbb-a1e7-b87889287cbf(cell1) while migrating {{(pid=98844) _set_requested_destination_cell /opt/stack/nova/nova/conductor/tasks/migrate.py:208}} May 28 14:43:44.767910 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.tasks.migrate [None req-ef18b9b2-6ded-4b00-ab8a-ceaf67f1ce2c tempest-DeleteServersTestJSON-1804090497 tempest-DeleteServersTestJSON-1804090497-project] Created allocations for migration cd9d39ff-2ebe-438f-871e-9fd43811cf86 on d4341c2e-3ff0-43f5-9b7e-4ec6191a47d4 {{(pid=98844) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} May 28 14:43:44.970237 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.tasks.migrate [None req-ef18b9b2-6ded-4b00-ab8a-ceaf67f1ce2c tempest-DeleteServersTestJSON-1804090497 tempest-DeleteServersTestJSON-1804090497-project] [instance: a6fbfe2a-36a2-4873-803d-4fe695f23ea1] Calling prep_resize with selected host: n-h2-791503-6; Selected node: n-h2-791503-6; Alternates: [Selection(allocation_request='{"allocations": {"d4341c2e-3ff0-43f5-9b7e-4ec6191a47d4": {"resources": {"DISK_GB": 1, "MEMORY_MB": 512, "VCPU": 1}}}, "mappings": {"": ["d4341c2e-3ff0-43f5-9b7e-4ec6191a47d4"]}}',allocation_request_version='1.35',availability_zone='nova',cell_uuid=b241212c-c279-4fbb-a1e7-b87889287cbf,compute_node_uuid=d4341c2e-3ff0-43f5-9b7e-4ec6191a47d4,limits=SchedulerLimits,nodename='n-h1-791503-6',service_host='n-h1-791503-6')] {{(pid=98844) _execute /opt/stack/nova/nova/conductor/tasks/migrate.py:315}} May 28 14:44:27.583048 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-a007d2dc-25ef-4f27-b71f-78c04e3719e2 tempest-ServerDiskConfigTestJSON-784255549 tempest-ServerDiskConfigTestJSON-784255549-project] Took 0.21 seconds to select destinations for 1 instance(s). {{(pid=98843) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 14:44:27.606479 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-a007d2dc-25ef-4f27-b71f-78c04e3719e2 tempest-ServerDiskConfigTestJSON-784255549 tempest-ServerDiskConfigTestJSON-784255549-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:44:27.606871 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-a007d2dc-25ef-4f27-b71f-78c04e3719e2 tempest-ServerDiskConfigTestJSON-784255549 tempest-ServerDiskConfigTestJSON-784255549-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:44:27.660557 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-a007d2dc-25ef-4f27-b71f-78c04e3719e2 tempest-ServerDiskConfigTestJSON-784255549 tempest-ServerDiskConfigTestJSON-784255549-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:44:27.660963 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-a007d2dc-25ef-4f27-b71f-78c04e3719e2 tempest-ServerDiskConfigTestJSON-784255549 tempest-ServerDiskConfigTestJSON-784255549-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:44:27.661688 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-a007d2dc-25ef-4f27-b71f-78c04e3719e2 tempest-ServerDiskConfigTestJSON-784255549 tempest-ServerDiskConfigTestJSON-784255549-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:44:27.662082 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-a007d2dc-25ef-4f27-b71f-78c04e3719e2 tempest-ServerDiskConfigTestJSON-784255549 tempest-ServerDiskConfigTestJSON-784255549-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:44:27.677870 n-d-791503-6 nova-conductor[98843]: DEBUG nova.quota [None req-a007d2dc-25ef-4f27-b71f-78c04e3719e2 tempest-ServerDiskConfigTestJSON-784255549 tempest-ServerDiskConfigTestJSON-784255549-project] Getting quotas for project d8487c3fc8334d3fb376329d2df97615. Resources: {'cores', 'ram', 'instances'} {{(pid=98843) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 14:44:27.683170 n-d-791503-6 nova-conductor[98843]: DEBUG nova.quota [None req-a007d2dc-25ef-4f27-b71f-78c04e3719e2 tempest-ServerDiskConfigTestJSON-784255549 tempest-ServerDiskConfigTestJSON-784255549-project] Getting quotas for user df1a5cfd733d4feb9d9e43227ee2d1e0 and project d8487c3fc8334d3fb376329d2df97615. Resources: {'cores', 'ram', 'instances'} {{(pid=98843) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 14:44:27.694744 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-a007d2dc-25ef-4f27-b71f-78c04e3719e2 tempest-ServerDiskConfigTestJSON-784255549 tempest-ServerDiskConfigTestJSON-784255549-project] [instance: 443d4cbf-7632-49d7-9129-744dd79db031] Selected host: n-h2-791503-6; Selected node: n-h2-791503-6; Alternates: [('n-h1-791503-6', 'n-h1-791503-6')] {{(pid=98843) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 14:44:27.695782 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-a007d2dc-25ef-4f27-b71f-78c04e3719e2 tempest-ServerDiskConfigTestJSON-784255549 tempest-ServerDiskConfigTestJSON-784255549-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:44:27.696195 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-a007d2dc-25ef-4f27-b71f-78c04e3719e2 tempest-ServerDiskConfigTestJSON-784255549 tempest-ServerDiskConfigTestJSON-784255549-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:44:27.703562 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-a007d2dc-25ef-4f27-b71f-78c04e3719e2 tempest-ServerDiskConfigTestJSON-784255549 tempest-ServerDiskConfigTestJSON-784255549-project] [instance: 443d4cbf-7632-49d7-9129-744dd79db031] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='64f6036b-99a9-40e4-8963-3cdf66964954',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98843) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 14:44:27.704941 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-a007d2dc-25ef-4f27-b71f-78c04e3719e2 tempest-ServerDiskConfigTestJSON-784255549 tempest-ServerDiskConfigTestJSON-784255549-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:44:27.705397 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-a007d2dc-25ef-4f27-b71f-78c04e3719e2 tempest-ServerDiskConfigTestJSON-784255549 tempest-ServerDiskConfigTestJSON-784255549-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:44:27.732967 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-a007d2dc-25ef-4f27-b71f-78c04e3719e2 tempest-ServerDiskConfigTestJSON-784255549 tempest-ServerDiskConfigTestJSON-784255549-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:44:27.733429 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-a007d2dc-25ef-4f27-b71f-78c04e3719e2 tempest-ServerDiskConfigTestJSON-784255549 tempest-ServerDiskConfigTestJSON-784255549-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:44:37.163473 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.manager [None req-1ebfe879-6426-4b71-8170-95f04e52c533 tempest-ServerDiskConfigTestJSON-784255549 tempest-ServerDiskConfigTestJSON-784255549-project] Targeting cell b241212c-c279-4fbb-a1e7-b87889287cbf(cell1) for conductor method migrate_server {{(pid=98844) wrapper /opt/stack/nova/nova/conductor/manager.py:91}} May 28 14:44:37.163981 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-1ebfe879-6426-4b71-8170-95f04e52c533 tempest-ServerDiskConfigTestJSON-784255549 tempest-ServerDiskConfigTestJSON-784255549-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:44:37.164337 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-1ebfe879-6426-4b71-8170-95f04e52c533 tempest-ServerDiskConfigTestJSON-784255549 tempest-ServerDiskConfigTestJSON-784255549-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:44:37.278012 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.tasks.migrate [None req-1ebfe879-6426-4b71-8170-95f04e52c533 tempest-ServerDiskConfigTestJSON-784255549 tempest-ServerDiskConfigTestJSON-784255549-project] [instance: 443d4cbf-7632-49d7-9129-744dd79db031] Restricting to cell b241212c-c279-4fbb-a1e7-b87889287cbf(cell1) while migrating {{(pid=98844) _set_requested_destination_cell /opt/stack/nova/nova/conductor/tasks/migrate.py:208}} May 28 14:44:37.616103 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.tasks.migrate [None req-1ebfe879-6426-4b71-8170-95f04e52c533 tempest-ServerDiskConfigTestJSON-784255549 tempest-ServerDiskConfigTestJSON-784255549-project] Created allocations for migration 64d1cfbc-79b0-4b58-96a7-a0fcb542e5bc on 5c5ac110-743a-4b71-a058-d2597ba8e0c9 {{(pid=98844) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} May 28 14:44:37.829694 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.tasks.migrate [None req-1ebfe879-6426-4b71-8170-95f04e52c533 tempest-ServerDiskConfigTestJSON-784255549 tempest-ServerDiskConfigTestJSON-784255549-project] [instance: 443d4cbf-7632-49d7-9129-744dd79db031] Calling prep_resize with selected host: n-h1-791503-6; Selected node: n-h1-791503-6; Alternates: [Selection(allocation_request='{"allocations": {"5c5ac110-743a-4b71-a058-d2597ba8e0c9": {"resources": {"DISK_GB": 1, "MEMORY_MB": 512, "VCPU": 1}}}, "mappings": {"": ["5c5ac110-743a-4b71-a058-d2597ba8e0c9"]}}',allocation_request_version='1.35',availability_zone='nova',cell_uuid=b241212c-c279-4fbb-a1e7-b87889287cbf,compute_node_uuid=5c5ac110-743a-4b71-a058-d2597ba8e0c9,limits=SchedulerLimits,nodename='n-h2-791503-6',service_host='n-h2-791503-6')] {{(pid=98844) _execute /opt/stack/nova/nova/conductor/tasks/migrate.py:315}} May 28 14:44:45.764707 n-d-791503-6 nova-conductor[98843]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 14:45:17.354662 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-ae8cfccf-fd99-45fa-bce4-247692362a0a tempest-ServerDiskConfigTestJSON-784255549 tempest-ServerDiskConfigTestJSON-784255549-project] Took 0.20 seconds to select destinations for 1 instance(s). {{(pid=98843) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 14:45:17.379579 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-ae8cfccf-fd99-45fa-bce4-247692362a0a tempest-ServerDiskConfigTestJSON-784255549 tempest-ServerDiskConfigTestJSON-784255549-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:45:17.379985 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-ae8cfccf-fd99-45fa-bce4-247692362a0a tempest-ServerDiskConfigTestJSON-784255549 tempest-ServerDiskConfigTestJSON-784255549-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:45:17.426645 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-ae8cfccf-fd99-45fa-bce4-247692362a0a tempest-ServerDiskConfigTestJSON-784255549 tempest-ServerDiskConfigTestJSON-784255549-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:45:17.426950 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-ae8cfccf-fd99-45fa-bce4-247692362a0a tempest-ServerDiskConfigTestJSON-784255549 tempest-ServerDiskConfigTestJSON-784255549-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:45:17.427704 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-ae8cfccf-fd99-45fa-bce4-247692362a0a tempest-ServerDiskConfigTestJSON-784255549 tempest-ServerDiskConfigTestJSON-784255549-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:45:17.428082 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-ae8cfccf-fd99-45fa-bce4-247692362a0a tempest-ServerDiskConfigTestJSON-784255549 tempest-ServerDiskConfigTestJSON-784255549-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:45:17.443283 n-d-791503-6 nova-conductor[98843]: DEBUG nova.quota [None req-ae8cfccf-fd99-45fa-bce4-247692362a0a tempest-ServerDiskConfigTestJSON-784255549 tempest-ServerDiskConfigTestJSON-784255549-project] Getting quotas for project d8487c3fc8334d3fb376329d2df97615. Resources: {'cores', 'ram', 'instances'} {{(pid=98843) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 14:45:17.448052 n-d-791503-6 nova-conductor[98843]: DEBUG nova.quota [None req-ae8cfccf-fd99-45fa-bce4-247692362a0a tempest-ServerDiskConfigTestJSON-784255549 tempest-ServerDiskConfigTestJSON-784255549-project] Getting quotas for user df1a5cfd733d4feb9d9e43227ee2d1e0 and project d8487c3fc8334d3fb376329d2df97615. Resources: {'cores', 'ram', 'instances'} {{(pid=98843) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 14:45:17.458208 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-ae8cfccf-fd99-45fa-bce4-247692362a0a tempest-ServerDiskConfigTestJSON-784255549 tempest-ServerDiskConfigTestJSON-784255549-project] [instance: 58c81ac8-cc3c-493e-b744-55af95644533] Selected host: n-h2-791503-6; Selected node: n-h2-791503-6; Alternates: [('n-h1-791503-6', 'n-h1-791503-6')] {{(pid=98843) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 14:45:17.459154 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-ae8cfccf-fd99-45fa-bce4-247692362a0a tempest-ServerDiskConfigTestJSON-784255549 tempest-ServerDiskConfigTestJSON-784255549-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:45:17.459546 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-ae8cfccf-fd99-45fa-bce4-247692362a0a tempest-ServerDiskConfigTestJSON-784255549 tempest-ServerDiskConfigTestJSON-784255549-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:45:17.465805 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-ae8cfccf-fd99-45fa-bce4-247692362a0a tempest-ServerDiskConfigTestJSON-784255549 tempest-ServerDiskConfigTestJSON-784255549-project] [instance: 58c81ac8-cc3c-493e-b744-55af95644533] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='64f6036b-99a9-40e4-8963-3cdf66964954',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98843) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 14:45:17.467262 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-ae8cfccf-fd99-45fa-bce4-247692362a0a tempest-ServerDiskConfigTestJSON-784255549 tempest-ServerDiskConfigTestJSON-784255549-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:45:17.467652 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-ae8cfccf-fd99-45fa-bce4-247692362a0a tempest-ServerDiskConfigTestJSON-784255549 tempest-ServerDiskConfigTestJSON-784255549-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:45:17.496178 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-ae8cfccf-fd99-45fa-bce4-247692362a0a tempest-ServerDiskConfigTestJSON-784255549 tempest-ServerDiskConfigTestJSON-784255549-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:45:17.496544 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-ae8cfccf-fd99-45fa-bce4-247692362a0a tempest-ServerDiskConfigTestJSON-784255549 tempest-ServerDiskConfigTestJSON-784255549-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:45:27.724581 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.manager [None req-a7915c8c-e72c-489f-b18e-38eff3989b0f tempest-ServerDiskConfigTestJSON-784255549 tempest-ServerDiskConfigTestJSON-784255549-project] Targeting cell b241212c-c279-4fbb-a1e7-b87889287cbf(cell1) for conductor method migrate_server {{(pid=98844) wrapper /opt/stack/nova/nova/conductor/manager.py:91}} May 28 14:45:27.725271 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-a7915c8c-e72c-489f-b18e-38eff3989b0f tempest-ServerDiskConfigTestJSON-784255549 tempest-ServerDiskConfigTestJSON-784255549-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:45:27.725579 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-a7915c8c-e72c-489f-b18e-38eff3989b0f tempest-ServerDiskConfigTestJSON-784255549 tempest-ServerDiskConfigTestJSON-784255549-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:45:27.841874 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.tasks.migrate [None req-a7915c8c-e72c-489f-b18e-38eff3989b0f tempest-ServerDiskConfigTestJSON-784255549 tempest-ServerDiskConfigTestJSON-784255549-project] [instance: 58c81ac8-cc3c-493e-b744-55af95644533] Restricting to cell b241212c-c279-4fbb-a1e7-b87889287cbf(cell1) while migrating {{(pid=98844) _set_requested_destination_cell /opt/stack/nova/nova/conductor/tasks/migrate.py:208}} May 28 14:45:28.168046 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.tasks.migrate [None req-a7915c8c-e72c-489f-b18e-38eff3989b0f tempest-ServerDiskConfigTestJSON-784255549 tempest-ServerDiskConfigTestJSON-784255549-project] Created allocations for migration 7e7d40ad-06c8-4ad8-b823-aba106e6d528 on 5c5ac110-743a-4b71-a058-d2597ba8e0c9 {{(pid=98844) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} May 28 14:45:28.387094 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.tasks.migrate [None req-a7915c8c-e72c-489f-b18e-38eff3989b0f tempest-ServerDiskConfigTestJSON-784255549 tempest-ServerDiskConfigTestJSON-784255549-project] [instance: 58c81ac8-cc3c-493e-b744-55af95644533] Calling prep_resize with selected host: n-h1-791503-6; Selected node: n-h1-791503-6; Alternates: [Selection(allocation_request='{"allocations": {"5c5ac110-743a-4b71-a058-d2597ba8e0c9": {"resources": {"DISK_GB": 1, "MEMORY_MB": 512, "VCPU": 1}}}, "mappings": {"": ["5c5ac110-743a-4b71-a058-d2597ba8e0c9"]}}',allocation_request_version='1.35',availability_zone='nova',cell_uuid=b241212c-c279-4fbb-a1e7-b87889287cbf,compute_node_uuid=5c5ac110-743a-4b71-a058-d2597ba8e0c9,limits=SchedulerLimits,nodename='n-h2-791503-6',service_host='n-h2-791503-6')] {{(pid=98844) _execute /opt/stack/nova/nova/conductor/tasks/migrate.py:315}} May 28 14:45:39.730567 n-d-791503-6 nova-conductor[98843]: ERROR oslo.messaging._drivers.impl_rabbit [-] [fb67aa64-250d-4c34-b696-14a5dd0b49b6] AMQP server on 10.222.0.68:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection May 28 14:45:40.746977 n-d-791503-6 nova-conductor[98843]: INFO oslo.messaging._drivers.impl_rabbit [-] [fb67aa64-250d-4c34-b696-14a5dd0b49b6] Reconnected to AMQP server on 10.222.0.68:5672 via [amqp] client with port 60840. May 28 14:45:48.275010 n-d-791503-6 nova-conductor[98844]: ERROR oslo.messaging._drivers.impl_rabbit [-] [cbd7c90c-b59a-4f8b-992f-d04ba5ad6f9c] AMQP server on 10.222.0.68:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection May 28 14:45:49.293312 n-d-791503-6 nova-conductor[98844]: INFO oslo.messaging._drivers.impl_rabbit [-] [cbd7c90c-b59a-4f8b-992f-d04ba5ad6f9c] Reconnected to AMQP server on 10.222.0.68:5672 via [amqp] client with port 60860. May 28 14:46:22.829658 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-2dc36be2-1b87-4c19-998a-1f54a268d5ae tempest-ServerActionsTestJSON-382598040 tempest-ServerActionsTestJSON-382598040-project] Took 0.24 seconds to select destinations for 1 instance(s). {{(pid=98843) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 14:46:22.854149 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-2dc36be2-1b87-4c19-998a-1f54a268d5ae tempest-ServerActionsTestJSON-382598040 tempest-ServerActionsTestJSON-382598040-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:46:22.854558 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-2dc36be2-1b87-4c19-998a-1f54a268d5ae tempest-ServerActionsTestJSON-382598040 tempest-ServerActionsTestJSON-382598040-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:46:22.913964 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-2dc36be2-1b87-4c19-998a-1f54a268d5ae tempest-ServerActionsTestJSON-382598040 tempest-ServerActionsTestJSON-382598040-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:46:22.914365 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-2dc36be2-1b87-4c19-998a-1f54a268d5ae tempest-ServerActionsTestJSON-382598040 tempest-ServerActionsTestJSON-382598040-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:46:22.915322 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-2dc36be2-1b87-4c19-998a-1f54a268d5ae tempest-ServerActionsTestJSON-382598040 tempest-ServerActionsTestJSON-382598040-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:46:22.915861 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-2dc36be2-1b87-4c19-998a-1f54a268d5ae tempest-ServerActionsTestJSON-382598040 tempest-ServerActionsTestJSON-382598040-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:46:22.932878 n-d-791503-6 nova-conductor[98843]: DEBUG nova.quota [None req-2dc36be2-1b87-4c19-998a-1f54a268d5ae tempest-ServerActionsTestJSON-382598040 tempest-ServerActionsTestJSON-382598040-project] Getting quotas for project 5cd4c7649e354f9fa447c1e3cc537f79. Resources: {'cores', 'ram', 'instances'} {{(pid=98843) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 14:46:22.937650 n-d-791503-6 nova-conductor[98843]: DEBUG nova.quota [None req-2dc36be2-1b87-4c19-998a-1f54a268d5ae tempest-ServerActionsTestJSON-382598040 tempest-ServerActionsTestJSON-382598040-project] Getting quotas for user 36eff993304c4f7082d8412715f71c59 and project 5cd4c7649e354f9fa447c1e3cc537f79. Resources: {'cores', 'ram', 'instances'} {{(pid=98843) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 14:46:22.949731 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-2dc36be2-1b87-4c19-998a-1f54a268d5ae tempest-ServerActionsTestJSON-382598040 tempest-ServerActionsTestJSON-382598040-project] [instance: 8660b800-b1d7-4d2b-a77e-9093f0c9a717] Selected host: n-h2-791503-6; Selected node: n-h2-791503-6; Alternates: [('n-h1-791503-6', 'n-h1-791503-6')] {{(pid=98843) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 14:46:22.951454 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-2dc36be2-1b87-4c19-998a-1f54a268d5ae tempest-ServerActionsTestJSON-382598040 tempest-ServerActionsTestJSON-382598040-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:46:22.951454 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-2dc36be2-1b87-4c19-998a-1f54a268d5ae tempest-ServerActionsTestJSON-382598040 tempest-ServerActionsTestJSON-382598040-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:46:22.960762 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-2dc36be2-1b87-4c19-998a-1f54a268d5ae tempest-ServerActionsTestJSON-382598040 tempest-ServerActionsTestJSON-382598040-project] [instance: 8660b800-b1d7-4d2b-a77e-9093f0c9a717] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='64f6036b-99a9-40e4-8963-3cdf66964954',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98843) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 14:46:22.963240 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-2dc36be2-1b87-4c19-998a-1f54a268d5ae tempest-ServerActionsTestJSON-382598040 tempest-ServerActionsTestJSON-382598040-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:46:22.964652 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-2dc36be2-1b87-4c19-998a-1f54a268d5ae tempest-ServerActionsTestJSON-382598040 tempest-ServerActionsTestJSON-382598040-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:46:22.997834 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-2dc36be2-1b87-4c19-998a-1f54a268d5ae tempest-ServerActionsTestJSON-382598040 tempest-ServerActionsTestJSON-382598040-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:46:22.998361 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-2dc36be2-1b87-4c19-998a-1f54a268d5ae tempest-ServerActionsTestJSON-382598040 tempest-ServerActionsTestJSON-382598040-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:46:56.425497 n-d-791503-6 nova-conductor[98844]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 14:47:30.096686 n-d-791503-6 nova-conductor[98844]: ERROR oslo.messaging._drivers.impl_rabbit [-] [8840711a-c4c2-4555-9645-ce157ee9cc0d] AMQP server on 10.222.0.68:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 28 14:47:31.117648 n-d-791503-6 nova-conductor[98844]: INFO oslo.messaging._drivers.impl_rabbit [-] [8840711a-c4c2-4555-9645-ce157ee9cc0d] Reconnected to AMQP server on 10.222.0.68:5672 via [amqp] client with port 32930. May 28 14:47:50.342903 n-d-791503-6 nova-conductor[98844]: ERROR oslo.messaging._drivers.impl_rabbit [-] [abccac45-5c00-4182-bcd1-fb6828b957ad] AMQP server on 10.222.0.68:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 28 14:47:51.359088 n-d-791503-6 nova-conductor[98844]: INFO oslo.messaging._drivers.impl_rabbit [-] [abccac45-5c00-4182-bcd1-fb6828b957ad] Reconnected to AMQP server on 10.222.0.68:5672 via [amqp] client with port 32970. May 28 14:48:05.780950 n-d-791503-6 nova-conductor[98843]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 14:48:10.848999 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-7c7b59f4-3996-49b2-a568-776fc8b4fdec tempest-ServerActionsTestJSON-382598040 tempest-ServerActionsTestJSON-382598040-project] Targeting cell b241212c-c279-4fbb-a1e7-b87889287cbf(cell1) for conductor method migrate_server {{(pid=98843) wrapper /opt/stack/nova/nova/conductor/manager.py:91}} May 28 14:48:10.849658 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-7c7b59f4-3996-49b2-a568-776fc8b4fdec tempest-ServerActionsTestJSON-382598040 tempest-ServerActionsTestJSON-382598040-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:48:10.850438 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-7c7b59f4-3996-49b2-a568-776fc8b4fdec tempest-ServerActionsTestJSON-382598040 tempest-ServerActionsTestJSON-382598040-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:48:11.006860 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.tasks.migrate [None req-7c7b59f4-3996-49b2-a568-776fc8b4fdec tempest-ServerActionsTestJSON-382598040 tempest-ServerActionsTestJSON-382598040-project] [instance: 8660b800-b1d7-4d2b-a77e-9093f0c9a717] Restricting to cell b241212c-c279-4fbb-a1e7-b87889287cbf(cell1) while migrating {{(pid=98843) _set_requested_destination_cell /opt/stack/nova/nova/conductor/tasks/migrate.py:208}} May 28 14:48:11.295613 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.tasks.migrate [None req-7c7b59f4-3996-49b2-a568-776fc8b4fdec tempest-ServerActionsTestJSON-382598040 tempest-ServerActionsTestJSON-382598040-project] Created allocations for migration 37402fcc-4a07-4456-95c2-e2b521b58b98 on 5c5ac110-743a-4b71-a058-d2597ba8e0c9 {{(pid=98843) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} May 28 14:48:11.600865 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.tasks.migrate [None req-7c7b59f4-3996-49b2-a568-776fc8b4fdec tempest-ServerActionsTestJSON-382598040 tempest-ServerActionsTestJSON-382598040-project] [instance: 8660b800-b1d7-4d2b-a77e-9093f0c9a717] Calling prep_resize with selected host: n-h1-791503-6; Selected node: n-h1-791503-6; Alternates: [Selection(allocation_request='{"allocations": {"5c5ac110-743a-4b71-a058-d2597ba8e0c9": {"resources": {"DISK_GB": 1, "MEMORY_MB": 512, "VCPU": 1}}}, "mappings": {"": ["5c5ac110-743a-4b71-a058-d2597ba8e0c9"]}}',allocation_request_version='1.35',availability_zone='nova',cell_uuid=b241212c-c279-4fbb-a1e7-b87889287cbf,compute_node_uuid=5c5ac110-743a-4b71-a058-d2597ba8e0c9,limits=SchedulerLimits,nodename='n-h2-791503-6',service_host='n-h2-791503-6')] {{(pid=98843) _execute /opt/stack/nova/nova/conductor/tasks/migrate.py:315}} May 28 14:48:40.747897 n-d-791503-6 nova-conductor[98843]: ERROR oslo.messaging._drivers.impl_rabbit [-] [fb67aa64-250d-4c34-b696-14a5dd0b49b6] AMQP server on 10.222.0.68:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection May 28 14:48:41.769969 n-d-791503-6 nova-conductor[98843]: INFO oslo.messaging._drivers.impl_rabbit [-] [fb67aa64-250d-4c34-b696-14a5dd0b49b6] Reconnected to AMQP server on 10.222.0.68:5672 via [amqp] client with port 33116. May 28 14:48:46.208461 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.manager [None req-e1c65b0e-41d3-4e24-98b1-e735f307f710 tempest-ServerActionsTestJSON-382598040 tempest-ServerActionsTestJSON-382598040-project] Took 0.21 seconds to select destinations for 1 instance(s). {{(pid=98844) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 14:48:46.231198 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-e1c65b0e-41d3-4e24-98b1-e735f307f710 tempest-ServerActionsTestJSON-382598040 tempest-ServerActionsTestJSON-382598040-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:48:46.231606 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-e1c65b0e-41d3-4e24-98b1-e735f307f710 tempest-ServerActionsTestJSON-382598040 tempest-ServerActionsTestJSON-382598040-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:48:46.275553 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-e1c65b0e-41d3-4e24-98b1-e735f307f710 tempest-ServerActionsTestJSON-382598040 tempest-ServerActionsTestJSON-382598040-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:48:46.275878 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-e1c65b0e-41d3-4e24-98b1-e735f307f710 tempest-ServerActionsTestJSON-382598040 tempest-ServerActionsTestJSON-382598040-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:48:46.276603 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-e1c65b0e-41d3-4e24-98b1-e735f307f710 tempest-ServerActionsTestJSON-382598040 tempest-ServerActionsTestJSON-382598040-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:48:46.276994 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-e1c65b0e-41d3-4e24-98b1-e735f307f710 tempest-ServerActionsTestJSON-382598040 tempest-ServerActionsTestJSON-382598040-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:48:46.298354 n-d-791503-6 nova-conductor[98844]: DEBUG nova.quota [None req-e1c65b0e-41d3-4e24-98b1-e735f307f710 tempest-ServerActionsTestJSON-382598040 tempest-ServerActionsTestJSON-382598040-project] Getting quotas for project 5cd4c7649e354f9fa447c1e3cc537f79. Resources: {'cores', 'ram', 'instances'} {{(pid=98844) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 14:48:46.303311 n-d-791503-6 nova-conductor[98844]: DEBUG nova.quota [None req-e1c65b0e-41d3-4e24-98b1-e735f307f710 tempest-ServerActionsTestJSON-382598040 tempest-ServerActionsTestJSON-382598040-project] Getting quotas for user 36eff993304c4f7082d8412715f71c59 and project 5cd4c7649e354f9fa447c1e3cc537f79. Resources: {'cores', 'ram', 'instances'} {{(pid=98844) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 14:48:46.314492 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.manager [None req-e1c65b0e-41d3-4e24-98b1-e735f307f710 tempest-ServerActionsTestJSON-382598040 tempest-ServerActionsTestJSON-382598040-project] [instance: 12f52749-259f-49c0-a232-7471a8fa61f9] Selected host: n-h1-791503-6; Selected node: n-h1-791503-6; Alternates: [('n-h2-791503-6', 'n-h2-791503-6')] {{(pid=98844) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 14:48:46.315498 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-e1c65b0e-41d3-4e24-98b1-e735f307f710 tempest-ServerActionsTestJSON-382598040 tempest-ServerActionsTestJSON-382598040-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:48:46.315891 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-e1c65b0e-41d3-4e24-98b1-e735f307f710 tempest-ServerActionsTestJSON-382598040 tempest-ServerActionsTestJSON-382598040-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:48:46.322112 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.manager [None req-e1c65b0e-41d3-4e24-98b1-e735f307f710 tempest-ServerActionsTestJSON-382598040 tempest-ServerActionsTestJSON-382598040-project] [instance: 12f52749-259f-49c0-a232-7471a8fa61f9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='64f6036b-99a9-40e4-8963-3cdf66964954',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98844) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 14:48:46.323300 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-e1c65b0e-41d3-4e24-98b1-e735f307f710 tempest-ServerActionsTestJSON-382598040 tempest-ServerActionsTestJSON-382598040-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:48:46.323690 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-e1c65b0e-41d3-4e24-98b1-e735f307f710 tempest-ServerActionsTestJSON-382598040 tempest-ServerActionsTestJSON-382598040-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:48:46.349191 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-e1c65b0e-41d3-4e24-98b1-e735f307f710 tempest-ServerActionsTestJSON-382598040 tempest-ServerActionsTestJSON-382598040-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:48:46.349593 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-e1c65b0e-41d3-4e24-98b1-e735f307f710 tempest-ServerActionsTestJSON-382598040 tempest-ServerActionsTestJSON-382598040-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:48:49.294480 n-d-791503-6 nova-conductor[98844]: ERROR oslo.messaging._drivers.impl_rabbit [-] [cbd7c90c-b59a-4f8b-992f-d04ba5ad6f9c] AMQP server on 10.222.0.68:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection May 28 14:48:50.313059 n-d-791503-6 nova-conductor[98844]: INFO oslo.messaging._drivers.impl_rabbit [-] [cbd7c90c-b59a-4f8b-992f-d04ba5ad6f9c] Reconnected to AMQP server on 10.222.0.68:5672 via [amqp] client with port 33160. May 28 14:50:16.444269 n-d-791503-6 nova-conductor[98844]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 14:50:26.970676 n-d-791503-6 nova-conductor[98843]: ERROR oslo.messaging._drivers.impl_rabbit [-] [eee199a3-5934-45a4-999a-298f0a81318b] AMQP server on 10.222.0.68:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 28 14:50:27.991948 n-d-791503-6 nova-conductor[98843]: INFO oslo.messaging._drivers.impl_rabbit [-] [eee199a3-5934-45a4-999a-298f0a81318b] Reconnected to AMQP server on 10.222.0.68:5672 via [amqp] client with port 33354. May 28 14:50:48.484335 n-d-791503-6 nova-conductor[98843]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4bc4adbd-2091-473e-8e44-b9a43f01ab64] AMQP server on 10.222.0.68:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 28 14:50:49.363013 n-d-791503-6 nova-conductor[98843]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 14:50:49.502329 n-d-791503-6 nova-conductor[98843]: INFO oslo.messaging._drivers.impl_rabbit [-] [4bc4adbd-2091-473e-8e44-b9a43f01ab64] Reconnected to AMQP server on 10.222.0.68:5672 via [amqp] client with port 33400. May 28 14:50:51.360701 n-d-791503-6 nova-conductor[98844]: ERROR oslo.messaging._drivers.impl_rabbit [-] [abccac45-5c00-4182-bcd1-fb6828b957ad] AMQP server on 10.222.0.68:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 28 14:50:52.376081 n-d-791503-6 nova-conductor[98844]: INFO oslo.messaging._drivers.impl_rabbit [-] [abccac45-5c00-4182-bcd1-fb6828b957ad] Reconnected to AMQP server on 10.222.0.68:5672 via [amqp] client with port 33408. May 28 14:51:25.797554 n-d-791503-6 nova-conductor[98843]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 14:51:31.114812 n-d-791503-6 nova-conductor[98844]: ERROR oslo.messaging._drivers.impl_rabbit [-] [8840711a-c4c2-4555-9645-ce157ee9cc0d] AMQP server on 10.222.0.68:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 28 14:51:32.136673 n-d-791503-6 nova-conductor[98844]: INFO oslo.messaging._drivers.impl_rabbit [-] [8840711a-c4c2-4555-9645-ce157ee9cc0d] Reconnected to AMQP server on 10.222.0.68:5672 via [amqp] client with port 33488. May 28 14:51:41.769471 n-d-791503-6 nova-conductor[98843]: ERROR oslo.messaging._drivers.impl_rabbit [-] [fb67aa64-250d-4c34-b696-14a5dd0b49b6] AMQP server on 10.222.0.68:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection May 28 14:51:42.787626 n-d-791503-6 nova-conductor[98843]: INFO oslo.messaging._drivers.impl_rabbit [-] [fb67aa64-250d-4c34-b696-14a5dd0b49b6] Reconnected to AMQP server on 10.222.0.68:5672 via [amqp] client with port 33514. May 28 14:51:44.312883 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-a6f49940-c31e-43c0-aa6a-ab3517e27e68 tempest-ServerActionsTestJSON-382598040 tempest-ServerActionsTestJSON-382598040-project] Targeting cell b241212c-c279-4fbb-a1e7-b87889287cbf(cell1) for conductor method migrate_server {{(pid=98843) wrapper /opt/stack/nova/nova/conductor/manager.py:91}} May 28 14:51:44.314067 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-a6f49940-c31e-43c0-aa6a-ab3517e27e68 tempest-ServerActionsTestJSON-382598040 tempest-ServerActionsTestJSON-382598040-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:51:44.314467 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-a6f49940-c31e-43c0-aa6a-ab3517e27e68 tempest-ServerActionsTestJSON-382598040 tempest-ServerActionsTestJSON-382598040-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:51:44.436538 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.tasks.migrate [None req-a6f49940-c31e-43c0-aa6a-ab3517e27e68 tempest-ServerActionsTestJSON-382598040 tempest-ServerActionsTestJSON-382598040-project] [instance: 12f52749-259f-49c0-a232-7471a8fa61f9] Restricting to cell b241212c-c279-4fbb-a1e7-b87889287cbf(cell1) while migrating {{(pid=98843) _set_requested_destination_cell /opt/stack/nova/nova/conductor/tasks/migrate.py:208}} May 28 14:51:44.730743 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.tasks.migrate [None req-a6f49940-c31e-43c0-aa6a-ab3517e27e68 tempest-ServerActionsTestJSON-382598040 tempest-ServerActionsTestJSON-382598040-project] Created allocations for migration 6d86ba07-5763-4ba8-84f4-52b829cafb2c on d4341c2e-3ff0-43f5-9b7e-4ec6191a47d4 {{(pid=98843) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} May 28 14:51:44.935548 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.tasks.migrate [None req-a6f49940-c31e-43c0-aa6a-ab3517e27e68 tempest-ServerActionsTestJSON-382598040 tempest-ServerActionsTestJSON-382598040-project] [instance: 12f52749-259f-49c0-a232-7471a8fa61f9] Calling prep_resize with selected host: n-h2-791503-6; Selected node: n-h2-791503-6; Alternates: [Selection(allocation_request='{"allocations": {"d4341c2e-3ff0-43f5-9b7e-4ec6191a47d4": {"resources": {"DISK_GB": 1, "MEMORY_MB": 512, "VCPU": 1}}}, "mappings": {"": ["d4341c2e-3ff0-43f5-9b7e-4ec6191a47d4"]}}',allocation_request_version='1.35',availability_zone='nova',cell_uuid=b241212c-c279-4fbb-a1e7-b87889287cbf,compute_node_uuid=d4341c2e-3ff0-43f5-9b7e-4ec6191a47d4,limits=SchedulerLimits,nodename='n-h1-791503-6',service_host='n-h1-791503-6')] {{(pid=98843) _execute /opt/stack/nova/nova/conductor/tasks/migrate.py:315}} May 28 14:51:50.314402 n-d-791503-6 nova-conductor[98844]: ERROR oslo.messaging._drivers.impl_rabbit [-] [cbd7c90c-b59a-4f8b-992f-d04ba5ad6f9c] AMQP server on 10.222.0.68:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 28 14:51:51.331134 n-d-791503-6 nova-conductor[98844]: INFO oslo.messaging._drivers.impl_rabbit [-] [cbd7c90c-b59a-4f8b-992f-d04ba5ad6f9c] Reconnected to AMQP server on 10.222.0.68:5672 via [amqp] client with port 33560. May 28 14:52:07.294001 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.manager [None req-f74450b0-bc91-4662-822b-76cac48ea16c tempest-ServerActionsTestJSON-382598040 tempest-ServerActionsTestJSON-382598040-project] Took 2.35 seconds to select destinations for 1 instance(s). {{(pid=98844) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 14:52:07.315413 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-f74450b0-bc91-4662-822b-76cac48ea16c tempest-ServerActionsTestJSON-382598040 tempest-ServerActionsTestJSON-382598040-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:52:07.315814 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-f74450b0-bc91-4662-822b-76cac48ea16c tempest-ServerActionsTestJSON-382598040 tempest-ServerActionsTestJSON-382598040-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:52:07.371017 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-f74450b0-bc91-4662-822b-76cac48ea16c tempest-ServerActionsTestJSON-382598040 tempest-ServerActionsTestJSON-382598040-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:52:07.371442 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-f74450b0-bc91-4662-822b-76cac48ea16c tempest-ServerActionsTestJSON-382598040 tempest-ServerActionsTestJSON-382598040-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:52:07.372156 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-f74450b0-bc91-4662-822b-76cac48ea16c tempest-ServerActionsTestJSON-382598040 tempest-ServerActionsTestJSON-382598040-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:52:07.372546 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-f74450b0-bc91-4662-822b-76cac48ea16c tempest-ServerActionsTestJSON-382598040 tempest-ServerActionsTestJSON-382598040-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:52:07.390393 n-d-791503-6 nova-conductor[98844]: DEBUG nova.quota [None req-f74450b0-bc91-4662-822b-76cac48ea16c tempest-ServerActionsTestJSON-382598040 tempest-ServerActionsTestJSON-382598040-project] Getting quotas for project 5cd4c7649e354f9fa447c1e3cc537f79. Resources: {'cores', 'ram', 'instances'} {{(pid=98844) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 14:52:07.394774 n-d-791503-6 nova-conductor[98844]: DEBUG nova.quota [None req-f74450b0-bc91-4662-822b-76cac48ea16c tempest-ServerActionsTestJSON-382598040 tempest-ServerActionsTestJSON-382598040-project] Getting quotas for user 36eff993304c4f7082d8412715f71c59 and project 5cd4c7649e354f9fa447c1e3cc537f79. Resources: {'cores', 'ram', 'instances'} {{(pid=98844) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 14:52:07.405416 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.manager [None req-f74450b0-bc91-4662-822b-76cac48ea16c tempest-ServerActionsTestJSON-382598040 tempest-ServerActionsTestJSON-382598040-project] [instance: b4738984-c4fc-4e66-b716-4b22e18243bb] Selected host: n-h2-791503-6; Selected node: n-h2-791503-6; Alternates: [('n-h1-791503-6', 'n-h1-791503-6')] {{(pid=98844) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 14:52:07.406381 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-f74450b0-bc91-4662-822b-76cac48ea16c tempest-ServerActionsTestJSON-382598040 tempest-ServerActionsTestJSON-382598040-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:52:07.406796 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-f74450b0-bc91-4662-822b-76cac48ea16c tempest-ServerActionsTestJSON-382598040 tempest-ServerActionsTestJSON-382598040-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:52:07.412748 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.manager [None req-f74450b0-bc91-4662-822b-76cac48ea16c tempest-ServerActionsTestJSON-382598040 tempest-ServerActionsTestJSON-382598040-project] [instance: b4738984-c4fc-4e66-b716-4b22e18243bb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='64f6036b-99a9-40e4-8963-3cdf66964954',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98844) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 14:52:07.413892 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-f74450b0-bc91-4662-822b-76cac48ea16c tempest-ServerActionsTestJSON-382598040 tempest-ServerActionsTestJSON-382598040-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:52:07.414285 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-f74450b0-bc91-4662-822b-76cac48ea16c tempest-ServerActionsTestJSON-382598040 tempest-ServerActionsTestJSON-382598040-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:52:07.440759 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-f74450b0-bc91-4662-822b-76cac48ea16c tempest-ServerActionsTestJSON-382598040 tempest-ServerActionsTestJSON-382598040-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:52:07.441217 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-f74450b0-bc91-4662-822b-76cac48ea16c tempest-ServerActionsTestJSON-382598040 tempest-ServerActionsTestJSON-382598040-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:53:36.461340 n-d-791503-6 nova-conductor[98844]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 14:53:49.501857 n-d-791503-6 nova-conductor[98843]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4bc4adbd-2091-473e-8e44-b9a43f01ab64] AMQP server on 10.222.0.68:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 28 14:53:50.522648 n-d-791503-6 nova-conductor[98843]: INFO oslo.messaging._drivers.impl_rabbit [-] [4bc4adbd-2091-473e-8e44-b9a43f01ab64] Reconnected to AMQP server on 10.222.0.68:5672 via [amqp] client with port 33844. May 28 14:53:57.456039 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-e5dd7f9f-b422-40a8-af06-d781f2377d0c tempest-ServerActionsTestJSON-382598040 tempest-ServerActionsTestJSON-382598040-project] Targeting cell b241212c-c279-4fbb-a1e7-b87889287cbf(cell1) for conductor method migrate_server {{(pid=98843) wrapper /opt/stack/nova/nova/conductor/manager.py:91}} May 28 14:53:57.456644 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-e5dd7f9f-b422-40a8-af06-d781f2377d0c tempest-ServerActionsTestJSON-382598040 tempest-ServerActionsTestJSON-382598040-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:53:57.456923 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-e5dd7f9f-b422-40a8-af06-d781f2377d0c tempest-ServerActionsTestJSON-382598040 tempest-ServerActionsTestJSON-382598040-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:53:57.610366 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.tasks.migrate [None req-e5dd7f9f-b422-40a8-af06-d781f2377d0c tempest-ServerActionsTestJSON-382598040 tempest-ServerActionsTestJSON-382598040-project] [instance: b4738984-c4fc-4e66-b716-4b22e18243bb] Restricting to cell b241212c-c279-4fbb-a1e7-b87889287cbf(cell1) while migrating {{(pid=98843) _set_requested_destination_cell /opt/stack/nova/nova/conductor/tasks/migrate.py:208}} May 28 14:53:57.913893 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.tasks.migrate [None req-e5dd7f9f-b422-40a8-af06-d781f2377d0c tempest-ServerActionsTestJSON-382598040 tempest-ServerActionsTestJSON-382598040-project] Created allocations for migration 70b437d3-c2b8-4044-ab58-b899d3ce1eba on 5c5ac110-743a-4b71-a058-d2597ba8e0c9 {{(pid=98843) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} May 28 14:53:58.210537 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.tasks.migrate [None req-e5dd7f9f-b422-40a8-af06-d781f2377d0c tempest-ServerActionsTestJSON-382598040 tempest-ServerActionsTestJSON-382598040-project] [instance: b4738984-c4fc-4e66-b716-4b22e18243bb] Calling prep_resize with selected host: n-h1-791503-6; Selected node: n-h1-791503-6; Alternates: [Selection(allocation_request='{"allocations": {"5c5ac110-743a-4b71-a058-d2597ba8e0c9": {"resources": {"DISK_GB": 1, "MEMORY_MB": 512, "VCPU": 1}}}, "mappings": {"": ["5c5ac110-743a-4b71-a058-d2597ba8e0c9"]}}',allocation_request_version='1.35',availability_zone='nova',cell_uuid=b241212c-c279-4fbb-a1e7-b87889287cbf,compute_node_uuid=5c5ac110-743a-4b71-a058-d2597ba8e0c9,limits=SchedulerLimits,nodename='n-h2-791503-6',service_host='n-h2-791503-6')] {{(pid=98843) _execute /opt/stack/nova/nova/conductor/tasks/migrate.py:315}} May 28 14:53:58.220503 n-d-791503-6 nova-conductor[98843]: ERROR oslo.messaging._drivers.impl_rabbit [None req-e5dd7f9f-b422-40a8-af06-d781f2377d0c tempest-ServerActionsTestJSON-382598040 tempest-ServerActionsTestJSON-382598040-project] [9282344d-1714-453f-af6a-f153528668cb] AMQP server on 10.222.0.68:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 28 14:53:59.237423 n-d-791503-6 nova-conductor[98843]: INFO oslo.messaging._drivers.impl_rabbit [None req-e5dd7f9f-b422-40a8-af06-d781f2377d0c tempest-ServerActionsTestJSON-382598040 tempest-ServerActionsTestJSON-382598040-project] [9282344d-1714-453f-af6a-f153528668cb] Reconnected to AMQP server on 10.222.0.68:5672 via [amqp] client with port 33900. May 28 14:54:32.134264 n-d-791503-6 nova-conductor[98844]: ERROR oslo.messaging._drivers.impl_rabbit [-] [8840711a-c4c2-4555-9645-ce157ee9cc0d] AMQP server on 10.222.0.68:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 28 14:54:33.161552 n-d-791503-6 nova-conductor[98844]: INFO oslo.messaging._drivers.impl_rabbit [-] [8840711a-c4c2-4555-9645-ce157ee9cc0d] Reconnected to AMQP server on 10.222.0.68:5672 via [amqp] client with port 33998. May 28 14:54:34.050462 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-c88593fd-4121-4281-b1e0-a72dfaf9b37f tempest-ServerActionsTestJSON-382598040 tempest-ServerActionsTestJSON-382598040-project] Took 0.23 seconds to select destinations for 1 instance(s). {{(pid=98843) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 14:54:34.074222 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-c88593fd-4121-4281-b1e0-a72dfaf9b37f tempest-ServerActionsTestJSON-382598040 tempest-ServerActionsTestJSON-382598040-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:54:34.074610 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-c88593fd-4121-4281-b1e0-a72dfaf9b37f tempest-ServerActionsTestJSON-382598040 tempest-ServerActionsTestJSON-382598040-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:54:34.127931 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-c88593fd-4121-4281-b1e0-a72dfaf9b37f tempest-ServerActionsTestJSON-382598040 tempest-ServerActionsTestJSON-382598040-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:54:34.128328 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-c88593fd-4121-4281-b1e0-a72dfaf9b37f tempest-ServerActionsTestJSON-382598040 tempest-ServerActionsTestJSON-382598040-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:54:34.129041 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-c88593fd-4121-4281-b1e0-a72dfaf9b37f tempest-ServerActionsTestJSON-382598040 tempest-ServerActionsTestJSON-382598040-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:54:34.129425 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-c88593fd-4121-4281-b1e0-a72dfaf9b37f tempest-ServerActionsTestJSON-382598040 tempest-ServerActionsTestJSON-382598040-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:54:34.145643 n-d-791503-6 nova-conductor[98843]: DEBUG nova.quota [None req-c88593fd-4121-4281-b1e0-a72dfaf9b37f tempest-ServerActionsTestJSON-382598040 tempest-ServerActionsTestJSON-382598040-project] Getting quotas for project 5cd4c7649e354f9fa447c1e3cc537f79. Resources: {'cores', 'ram', 'instances'} {{(pid=98843) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 14:54:34.150181 n-d-791503-6 nova-conductor[98843]: DEBUG nova.quota [None req-c88593fd-4121-4281-b1e0-a72dfaf9b37f tempest-ServerActionsTestJSON-382598040 tempest-ServerActionsTestJSON-382598040-project] Getting quotas for user 36eff993304c4f7082d8412715f71c59 and project 5cd4c7649e354f9fa447c1e3cc537f79. Resources: {'cores', 'ram', 'instances'} {{(pid=98843) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 14:54:34.161693 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-c88593fd-4121-4281-b1e0-a72dfaf9b37f tempest-ServerActionsTestJSON-382598040 tempest-ServerActionsTestJSON-382598040-project] [instance: bbc59cb9-5ea0-4610-801d-a771a5afa905] Selected host: n-h1-791503-6; Selected node: n-h1-791503-6; Alternates: [('n-h2-791503-6', 'n-h2-791503-6')] {{(pid=98843) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 14:54:34.162671 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-c88593fd-4121-4281-b1e0-a72dfaf9b37f tempest-ServerActionsTestJSON-382598040 tempest-ServerActionsTestJSON-382598040-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:54:34.163033 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-c88593fd-4121-4281-b1e0-a72dfaf9b37f tempest-ServerActionsTestJSON-382598040 tempest-ServerActionsTestJSON-382598040-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:54:34.170936 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-c88593fd-4121-4281-b1e0-a72dfaf9b37f tempest-ServerActionsTestJSON-382598040 tempest-ServerActionsTestJSON-382598040-project] [instance: bbc59cb9-5ea0-4610-801d-a771a5afa905] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='64f6036b-99a9-40e4-8963-3cdf66964954',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98843) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 14:54:34.172217 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-c88593fd-4121-4281-b1e0-a72dfaf9b37f tempest-ServerActionsTestJSON-382598040 tempest-ServerActionsTestJSON-382598040-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:54:34.172618 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-c88593fd-4121-4281-b1e0-a72dfaf9b37f tempest-ServerActionsTestJSON-382598040 tempest-ServerActionsTestJSON-382598040-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:54:34.205343 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-c88593fd-4121-4281-b1e0-a72dfaf9b37f tempest-ServerActionsTestJSON-382598040 tempest-ServerActionsTestJSON-382598040-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:54:34.205741 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-c88593fd-4121-4281-b1e0-a72dfaf9b37f tempest-ServerActionsTestJSON-382598040 tempest-ServerActionsTestJSON-382598040-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:54:42.788550 n-d-791503-6 nova-conductor[98843]: ERROR oslo.messaging._drivers.impl_rabbit [-] [fb67aa64-250d-4c34-b696-14a5dd0b49b6] AMQP server on 10.222.0.68:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection May 28 14:54:43.806226 n-d-791503-6 nova-conductor[98843]: INFO oslo.messaging._drivers.impl_rabbit [-] [fb67aa64-250d-4c34-b696-14a5dd0b49b6] Reconnected to AMQP server on 10.222.0.68:5672 via [amqp] client with port 34028. May 28 14:54:45.814485 n-d-791503-6 nova-conductor[98843]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 14:54:51.332696 n-d-791503-6 nova-conductor[98844]: ERROR oslo.messaging._drivers.impl_rabbit [-] [cbd7c90c-b59a-4f8b-992f-d04ba5ad6f9c] AMQP server on 10.222.0.68:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection May 28 14:54:52.349474 n-d-791503-6 nova-conductor[98844]: INFO oslo.messaging._drivers.impl_rabbit [-] [cbd7c90c-b59a-4f8b-992f-d04ba5ad6f9c] Reconnected to AMQP server on 10.222.0.68:5672 via [amqp] client with port 34056. May 28 14:54:52.379765 n-d-791503-6 nova-conductor[98844]: ERROR oslo.messaging._drivers.impl_rabbit [-] [abccac45-5c00-4182-bcd1-fb6828b957ad] AMQP server on 10.222.0.68:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 28 14:54:53.396149 n-d-791503-6 nova-conductor[98844]: INFO oslo.messaging._drivers.impl_rabbit [-] [abccac45-5c00-4182-bcd1-fb6828b957ad] Reconnected to AMQP server on 10.222.0.68:5672 via [amqp] client with port 34058. May 28 14:56:50.523860 n-d-791503-6 nova-conductor[98843]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4bc4adbd-2091-473e-8e44-b9a43f01ab64] AMQP server on 10.222.0.68:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 28 14:56:51.543173 n-d-791503-6 nova-conductor[98843]: INFO oslo.messaging._drivers.impl_rabbit [-] [4bc4adbd-2091-473e-8e44-b9a43f01ab64] Reconnected to AMQP server on 10.222.0.68:5672 via [amqp] client with port 34284. May 28 14:56:56.477850 n-d-791503-6 nova-conductor[98844]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 14:57:25.317915 n-d-791503-6 nova-conductor[98844]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 14:57:26.572235 n-d-791503-6 nova-conductor[98843]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 14:57:27.926574 n-d-791503-6 nova-conductor[98844]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 14:57:27.992065 n-d-791503-6 nova-conductor[98843]: ERROR oslo.messaging._drivers.impl_rabbit [-] [eee199a3-5934-45a4-999a-298f0a81318b] AMQP server on 10.222.0.68:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 28 14:57:29.013354 n-d-791503-6 nova-conductor[98843]: INFO oslo.messaging._drivers.impl_rabbit [-] [eee199a3-5934-45a4-999a-298f0a81318b] Reconnected to AMQP server on 10.222.0.68:5672 via [amqp] client with port 34396. May 28 14:57:29.384557 n-d-791503-6 nova-conductor[98843]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 14:57:31.028920 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.manager [None req-85576d48-6895-4a4d-bc94-2c8c6d780c7f tempest-ServerActionsTestJSON-382598040 tempest-ServerActionsTestJSON-382598040-project] Targeting cell b241212c-c279-4fbb-a1e7-b87889287cbf(cell1) for conductor method migrate_server {{(pid=98844) wrapper /opt/stack/nova/nova/conductor/manager.py:91}} May 28 14:57:31.029418 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-85576d48-6895-4a4d-bc94-2c8c6d780c7f tempest-ServerActionsTestJSON-382598040 tempest-ServerActionsTestJSON-382598040-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:57:31.030083 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-85576d48-6895-4a4d-bc94-2c8c6d780c7f tempest-ServerActionsTestJSON-382598040 tempest-ServerActionsTestJSON-382598040-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:57:31.267149 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.tasks.migrate [None req-85576d48-6895-4a4d-bc94-2c8c6d780c7f tempest-ServerActionsTestJSON-382598040 tempest-ServerActionsTestJSON-382598040-project] [instance: bbc59cb9-5ea0-4610-801d-a771a5afa905] Restricting to cell b241212c-c279-4fbb-a1e7-b87889287cbf(cell1) while migrating {{(pid=98844) _set_requested_destination_cell /opt/stack/nova/nova/conductor/tasks/migrate.py:208}} May 28 14:57:31.546257 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.tasks.migrate [None req-85576d48-6895-4a4d-bc94-2c8c6d780c7f tempest-ServerActionsTestJSON-382598040 tempest-ServerActionsTestJSON-382598040-project] Created allocations for migration 38a6d9bf-68b1-4f36-82b0-f36e2c1b76c6 on d4341c2e-3ff0-43f5-9b7e-4ec6191a47d4 {{(pid=98844) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} May 28 14:57:31.766270 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.tasks.migrate [None req-85576d48-6895-4a4d-bc94-2c8c6d780c7f tempest-ServerActionsTestJSON-382598040 tempest-ServerActionsTestJSON-382598040-project] [instance: bbc59cb9-5ea0-4610-801d-a771a5afa905] Calling prep_resize with selected host: n-h2-791503-6; Selected node: n-h2-791503-6; Alternates: [Selection(allocation_request='{"allocations": {"d4341c2e-3ff0-43f5-9b7e-4ec6191a47d4": {"resources": {"DISK_GB": 1, "MEMORY_MB": 512, "VCPU": 1}}}, "mappings": {"": ["d4341c2e-3ff0-43f5-9b7e-4ec6191a47d4"]}}',allocation_request_version='1.35',availability_zone='nova',cell_uuid=b241212c-c279-4fbb-a1e7-b87889287cbf,compute_node_uuid=d4341c2e-3ff0-43f5-9b7e-4ec6191a47d4,limits=SchedulerLimits,nodename='n-h1-791503-6',service_host='n-h1-791503-6')] {{(pid=98844) _execute /opt/stack/nova/nova/conductor/tasks/migrate.py:315}} May 28 14:57:43.807558 n-d-791503-6 nova-conductor[98843]: ERROR oslo.messaging._drivers.impl_rabbit [-] [fb67aa64-250d-4c34-b696-14a5dd0b49b6] AMQP server on 10.222.0.68:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 28 14:57:44.824375 n-d-791503-6 nova-conductor[98843]: INFO oslo.messaging._drivers.impl_rabbit [-] [fb67aa64-250d-4c34-b696-14a5dd0b49b6] Reconnected to AMQP server on 10.222.0.68:5672 via [amqp] client with port 34456. May 28 14:57:52.350750 n-d-791503-6 nova-conductor[98844]: ERROR oslo.messaging._drivers.impl_rabbit [-] [cbd7c90c-b59a-4f8b-992f-d04ba5ad6f9c] AMQP server on 10.222.0.68:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection May 28 14:57:53.367777 n-d-791503-6 nova-conductor[98844]: INFO oslo.messaging._drivers.impl_rabbit [-] [cbd7c90c-b59a-4f8b-992f-d04ba5ad6f9c] Reconnected to AMQP server on 10.222.0.68:5672 via [amqp] client with port 34478. May 28 14:58:05.831259 n-d-791503-6 nova-conductor[98843]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 14:58:44.731224 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-4a2a3347-6beb-4f29-a575-47e2caf24679 tempest-ServersNegativeTestJSON-1701282260 tempest-ServersNegativeTestJSON-1701282260-project] Took 0.39 seconds to select destinations for 1 instance(s). {{(pid=98843) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 14:58:44.752673 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-4a2a3347-6beb-4f29-a575-47e2caf24679 tempest-ServersNegativeTestJSON-1701282260 tempest-ServersNegativeTestJSON-1701282260-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:58:44.753139 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-4a2a3347-6beb-4f29-a575-47e2caf24679 tempest-ServersNegativeTestJSON-1701282260 tempest-ServersNegativeTestJSON-1701282260-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:58:44.800441 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-4a2a3347-6beb-4f29-a575-47e2caf24679 tempest-ServersNegativeTestJSON-1701282260 tempest-ServersNegativeTestJSON-1701282260-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:58:44.800836 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-4a2a3347-6beb-4f29-a575-47e2caf24679 tempest-ServersNegativeTestJSON-1701282260 tempest-ServersNegativeTestJSON-1701282260-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:58:44.801550 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-4a2a3347-6beb-4f29-a575-47e2caf24679 tempest-ServersNegativeTestJSON-1701282260 tempest-ServersNegativeTestJSON-1701282260-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:58:44.801932 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-4a2a3347-6beb-4f29-a575-47e2caf24679 tempest-ServersNegativeTestJSON-1701282260 tempest-ServersNegativeTestJSON-1701282260-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:58:44.817365 n-d-791503-6 nova-conductor[98843]: DEBUG nova.quota [None req-4a2a3347-6beb-4f29-a575-47e2caf24679 tempest-ServersNegativeTestJSON-1701282260 tempest-ServersNegativeTestJSON-1701282260-project] Getting quotas for project 652675d5819c4ca98912d1213320f8b8. Resources: {'cores', 'ram', 'instances'} {{(pid=98843) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 14:58:44.821804 n-d-791503-6 nova-conductor[98843]: DEBUG nova.quota [None req-4a2a3347-6beb-4f29-a575-47e2caf24679 tempest-ServersNegativeTestJSON-1701282260 tempest-ServersNegativeTestJSON-1701282260-project] Getting quotas for user 29d16ddd94ae430891a226a5aef2ce31 and project 652675d5819c4ca98912d1213320f8b8. Resources: {'cores', 'ram', 'instances'} {{(pid=98843) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 14:58:44.832088 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-4a2a3347-6beb-4f29-a575-47e2caf24679 tempest-ServersNegativeTestJSON-1701282260 tempest-ServersNegativeTestJSON-1701282260-project] [instance: 2a42e25a-2693-40b7-bddf-14b80f4265ef] Selected host: n-h2-791503-6; Selected node: n-h2-791503-6; Alternates: [('n-h1-791503-6', 'n-h1-791503-6')] {{(pid=98843) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 14:58:44.832980 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-4a2a3347-6beb-4f29-a575-47e2caf24679 tempest-ServersNegativeTestJSON-1701282260 tempest-ServersNegativeTestJSON-1701282260-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:58:44.833388 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-4a2a3347-6beb-4f29-a575-47e2caf24679 tempest-ServersNegativeTestJSON-1701282260 tempest-ServersNegativeTestJSON-1701282260-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:58:44.840157 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-4a2a3347-6beb-4f29-a575-47e2caf24679 tempest-ServersNegativeTestJSON-1701282260 tempest-ServersNegativeTestJSON-1701282260-project] [instance: 2a42e25a-2693-40b7-bddf-14b80f4265ef] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='64f6036b-99a9-40e4-8963-3cdf66964954',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98843) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 14:58:44.841822 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-4a2a3347-6beb-4f29-a575-47e2caf24679 tempest-ServersNegativeTestJSON-1701282260 tempest-ServersNegativeTestJSON-1701282260-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:58:44.842232 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-4a2a3347-6beb-4f29-a575-47e2caf24679 tempest-ServersNegativeTestJSON-1701282260 tempest-ServersNegativeTestJSON-1701282260-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:58:44.870537 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-4a2a3347-6beb-4f29-a575-47e2caf24679 tempest-ServersNegativeTestJSON-1701282260 tempest-ServersNegativeTestJSON-1701282260-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:58:44.870865 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-4a2a3347-6beb-4f29-a575-47e2caf24679 tempest-ServersNegativeTestJSON-1701282260 tempest-ServersNegativeTestJSON-1701282260-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:58:55.231191 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.manager [None req-2f89c5ac-0107-4242-a237-ac8c44035e45 tempest-ServersNegativeTestJSON-1701282260 tempest-ServersNegativeTestJSON-1701282260-project] Took 0.20 seconds to select destinations for 1 instance(s). {{(pid=98844) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 14:58:55.256572 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-2f89c5ac-0107-4242-a237-ac8c44035e45 tempest-ServersNegativeTestJSON-1701282260 tempest-ServersNegativeTestJSON-1701282260-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:58:55.256572 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-2f89c5ac-0107-4242-a237-ac8c44035e45 tempest-ServersNegativeTestJSON-1701282260 tempest-ServersNegativeTestJSON-1701282260-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:58:55.299396 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-2f89c5ac-0107-4242-a237-ac8c44035e45 tempest-ServersNegativeTestJSON-1701282260 tempest-ServersNegativeTestJSON-1701282260-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:58:55.299806 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-2f89c5ac-0107-4242-a237-ac8c44035e45 tempest-ServersNegativeTestJSON-1701282260 tempest-ServersNegativeTestJSON-1701282260-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:58:55.300528 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-2f89c5ac-0107-4242-a237-ac8c44035e45 tempest-ServersNegativeTestJSON-1701282260 tempest-ServersNegativeTestJSON-1701282260-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:58:55.300920 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-2f89c5ac-0107-4242-a237-ac8c44035e45 tempest-ServersNegativeTestJSON-1701282260 tempest-ServersNegativeTestJSON-1701282260-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:58:55.316503 n-d-791503-6 nova-conductor[98844]: DEBUG nova.quota [None req-2f89c5ac-0107-4242-a237-ac8c44035e45 tempest-ServersNegativeTestJSON-1701282260 tempest-ServersNegativeTestJSON-1701282260-project] Getting quotas for project 652675d5819c4ca98912d1213320f8b8. Resources: {'cores', 'ram', 'instances'} {{(pid=98844) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 14:58:55.320971 n-d-791503-6 nova-conductor[98844]: DEBUG nova.quota [None req-2f89c5ac-0107-4242-a237-ac8c44035e45 tempest-ServersNegativeTestJSON-1701282260 tempest-ServersNegativeTestJSON-1701282260-project] Getting quotas for user 29d16ddd94ae430891a226a5aef2ce31 and project 652675d5819c4ca98912d1213320f8b8. Resources: {'cores', 'ram', 'instances'} {{(pid=98844) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 14:58:55.331206 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.manager [None req-2f89c5ac-0107-4242-a237-ac8c44035e45 tempest-ServersNegativeTestJSON-1701282260 tempest-ServersNegativeTestJSON-1701282260-project] [instance: 46fa4804-267f-47ca-88bd-a7fbd32052a7] Selected host: n-h1-791503-6; Selected node: n-h1-791503-6; Alternates: [('n-h2-791503-6', 'n-h2-791503-6')] {{(pid=98844) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 14:58:55.332107 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-2f89c5ac-0107-4242-a237-ac8c44035e45 tempest-ServersNegativeTestJSON-1701282260 tempest-ServersNegativeTestJSON-1701282260-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:58:55.332505 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-2f89c5ac-0107-4242-a237-ac8c44035e45 tempest-ServersNegativeTestJSON-1701282260 tempest-ServersNegativeTestJSON-1701282260-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:58:55.339615 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.manager [None req-2f89c5ac-0107-4242-a237-ac8c44035e45 tempest-ServersNegativeTestJSON-1701282260 tempest-ServersNegativeTestJSON-1701282260-project] [instance: 46fa4804-267f-47ca-88bd-a7fbd32052a7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='64f6036b-99a9-40e4-8963-3cdf66964954',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98844) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 14:58:55.340819 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-2f89c5ac-0107-4242-a237-ac8c44035e45 tempest-ServersNegativeTestJSON-1701282260 tempest-ServersNegativeTestJSON-1701282260-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:58:55.341215 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-2f89c5ac-0107-4242-a237-ac8c44035e45 tempest-ServersNegativeTestJSON-1701282260 tempest-ServersNegativeTestJSON-1701282260-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 14:58:55.367626 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-2f89c5ac-0107-4242-a237-ac8c44035e45 tempest-ServersNegativeTestJSON-1701282260 tempest-ServersNegativeTestJSON-1701282260-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 14:58:55.368026 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-2f89c5ac-0107-4242-a237-ac8c44035e45 tempest-ServersNegativeTestJSON-1701282260 tempest-ServersNegativeTestJSON-1701282260-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 15:00:03.530307 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-fbc5d3a8-aea7-4efa-8306-af3560aa7e4b tempest-TestEncryptedCinderVolumes-1403131144 tempest-TestEncryptedCinderVolumes-1403131144-project] Took 0.28 seconds to select destinations for 1 instance(s). {{(pid=98843) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 15:00:03.561939 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-fbc5d3a8-aea7-4efa-8306-af3560aa7e4b tempest-TestEncryptedCinderVolumes-1403131144 tempest-TestEncryptedCinderVolumes-1403131144-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 15:00:03.562438 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-fbc5d3a8-aea7-4efa-8306-af3560aa7e4b tempest-TestEncryptedCinderVolumes-1403131144 tempest-TestEncryptedCinderVolumes-1403131144-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 15:00:03.627658 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-fbc5d3a8-aea7-4efa-8306-af3560aa7e4b tempest-TestEncryptedCinderVolumes-1403131144 tempest-TestEncryptedCinderVolumes-1403131144-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 15:00:03.628066 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-fbc5d3a8-aea7-4efa-8306-af3560aa7e4b tempest-TestEncryptedCinderVolumes-1403131144 tempest-TestEncryptedCinderVolumes-1403131144-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 15:00:03.628803 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-fbc5d3a8-aea7-4efa-8306-af3560aa7e4b tempest-TestEncryptedCinderVolumes-1403131144 tempest-TestEncryptedCinderVolumes-1403131144-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 15:00:03.629193 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-fbc5d3a8-aea7-4efa-8306-af3560aa7e4b tempest-TestEncryptedCinderVolumes-1403131144 tempest-TestEncryptedCinderVolumes-1403131144-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 15:00:03.650247 n-d-791503-6 nova-conductor[98843]: DEBUG nova.quota [None req-fbc5d3a8-aea7-4efa-8306-af3560aa7e4b tempest-TestEncryptedCinderVolumes-1403131144 tempest-TestEncryptedCinderVolumes-1403131144-project] Getting quotas for project b46f917a20cc412c8875dcd77c29e97c. Resources: {'cores', 'ram', 'instances'} {{(pid=98843) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 15:00:03.656038 n-d-791503-6 nova-conductor[98843]: DEBUG nova.quota [None req-fbc5d3a8-aea7-4efa-8306-af3560aa7e4b tempest-TestEncryptedCinderVolumes-1403131144 tempest-TestEncryptedCinderVolumes-1403131144-project] Getting quotas for user 4941f42615a4408dbf3dd81cd6d2d57d and project b46f917a20cc412c8875dcd77c29e97c. Resources: {'cores', 'ram', 'instances'} {{(pid=98843) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 15:00:03.670015 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-fbc5d3a8-aea7-4efa-8306-af3560aa7e4b tempest-TestEncryptedCinderVolumes-1403131144 tempest-TestEncryptedCinderVolumes-1403131144-project] [instance: f03d1f64-7c7f-4d89-849c-d4098328ff06] Selected host: n-h1-791503-6; Selected node: n-h1-791503-6; Alternates: [('n-h2-791503-6', 'n-h2-791503-6')] {{(pid=98843) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 15:00:03.671098 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-fbc5d3a8-aea7-4efa-8306-af3560aa7e4b tempest-TestEncryptedCinderVolumes-1403131144 tempest-TestEncryptedCinderVolumes-1403131144-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 15:00:03.671528 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-fbc5d3a8-aea7-4efa-8306-af3560aa7e4b tempest-TestEncryptedCinderVolumes-1403131144 tempest-TestEncryptedCinderVolumes-1403131144-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 15:00:03.679091 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-fbc5d3a8-aea7-4efa-8306-af3560aa7e4b tempest-TestEncryptedCinderVolumes-1403131144 tempest-TestEncryptedCinderVolumes-1403131144-project] [instance: f03d1f64-7c7f-4d89-849c-d4098328ff06] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='64f6036b-99a9-40e4-8963-3cdf66964954',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98843) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 15:00:03.680403 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-fbc5d3a8-aea7-4efa-8306-af3560aa7e4b tempest-TestEncryptedCinderVolumes-1403131144 tempest-TestEncryptedCinderVolumes-1403131144-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 15:00:03.680810 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-fbc5d3a8-aea7-4efa-8306-af3560aa7e4b tempest-TestEncryptedCinderVolumes-1403131144 tempest-TestEncryptedCinderVolumes-1403131144-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 15:00:03.717362 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-fbc5d3a8-aea7-4efa-8306-af3560aa7e4b tempest-TestEncryptedCinderVolumes-1403131144 tempest-TestEncryptedCinderVolumes-1403131144-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 15:00:03.717851 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-fbc5d3a8-aea7-4efa-8306-af3560aa7e4b tempest-TestEncryptedCinderVolumes-1403131144 tempest-TestEncryptedCinderVolumes-1403131144-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 15:00:16.495983 n-d-791503-6 nova-conductor[98844]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 15:00:44.662185 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.manager [None req-711173a9-a096-4a95-ae10-b0641a6aba4e tempest-TestEncryptedCinderVolumes-1403131144 tempest-TestEncryptedCinderVolumes-1403131144-project] Took 0.41 seconds to select destinations for 1 instance(s). {{(pid=98844) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 15:00:44.685499 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-711173a9-a096-4a95-ae10-b0641a6aba4e tempest-TestEncryptedCinderVolumes-1403131144 tempest-TestEncryptedCinderVolumes-1403131144-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 15:00:44.685902 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-711173a9-a096-4a95-ae10-b0641a6aba4e tempest-TestEncryptedCinderVolumes-1403131144 tempest-TestEncryptedCinderVolumes-1403131144-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 15:00:44.735460 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-711173a9-a096-4a95-ae10-b0641a6aba4e tempest-TestEncryptedCinderVolumes-1403131144 tempest-TestEncryptedCinderVolumes-1403131144-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 15:00:44.736142 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-711173a9-a096-4a95-ae10-b0641a6aba4e tempest-TestEncryptedCinderVolumes-1403131144 tempest-TestEncryptedCinderVolumes-1403131144-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 15:00:44.737384 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-711173a9-a096-4a95-ae10-b0641a6aba4e tempest-TestEncryptedCinderVolumes-1403131144 tempest-TestEncryptedCinderVolumes-1403131144-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 15:00:44.738054 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-711173a9-a096-4a95-ae10-b0641a6aba4e tempest-TestEncryptedCinderVolumes-1403131144 tempest-TestEncryptedCinderVolumes-1403131144-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 15:00:44.759780 n-d-791503-6 nova-conductor[98844]: DEBUG nova.quota [None req-711173a9-a096-4a95-ae10-b0641a6aba4e tempest-TestEncryptedCinderVolumes-1403131144 tempest-TestEncryptedCinderVolumes-1403131144-project] Getting quotas for project b46f917a20cc412c8875dcd77c29e97c. Resources: {'cores', 'ram', 'instances'} {{(pid=98844) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 15:00:44.764252 n-d-791503-6 nova-conductor[98844]: DEBUG nova.quota [None req-711173a9-a096-4a95-ae10-b0641a6aba4e tempest-TestEncryptedCinderVolumes-1403131144 tempest-TestEncryptedCinderVolumes-1403131144-project] Getting quotas for user 4941f42615a4408dbf3dd81cd6d2d57d and project b46f917a20cc412c8875dcd77c29e97c. Resources: {'cores', 'ram', 'instances'} {{(pid=98844) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 15:00:44.775191 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.manager [None req-711173a9-a096-4a95-ae10-b0641a6aba4e tempest-TestEncryptedCinderVolumes-1403131144 tempest-TestEncryptedCinderVolumes-1403131144-project] [instance: e5c37ae5-981b-42af-8a03-7da78571e916] Selected host: n-h1-791503-6; Selected node: n-h1-791503-6; Alternates: [('n-h2-791503-6', 'n-h2-791503-6')] {{(pid=98844) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 15:00:44.776142 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-711173a9-a096-4a95-ae10-b0641a6aba4e tempest-TestEncryptedCinderVolumes-1403131144 tempest-TestEncryptedCinderVolumes-1403131144-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 15:00:44.776549 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-711173a9-a096-4a95-ae10-b0641a6aba4e tempest-TestEncryptedCinderVolumes-1403131144 tempest-TestEncryptedCinderVolumes-1403131144-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 15:00:44.783382 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.manager [None req-711173a9-a096-4a95-ae10-b0641a6aba4e tempest-TestEncryptedCinderVolumes-1403131144 tempest-TestEncryptedCinderVolumes-1403131144-project] [instance: e5c37ae5-981b-42af-8a03-7da78571e916] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='64f6036b-99a9-40e4-8963-3cdf66964954',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98844) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 15:00:44.784730 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-711173a9-a096-4a95-ae10-b0641a6aba4e tempest-TestEncryptedCinderVolumes-1403131144 tempest-TestEncryptedCinderVolumes-1403131144-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 15:00:44.785228 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-711173a9-a096-4a95-ae10-b0641a6aba4e tempest-TestEncryptedCinderVolumes-1403131144 tempest-TestEncryptedCinderVolumes-1403131144-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 15:00:44.816024 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-711173a9-a096-4a95-ae10-b0641a6aba4e tempest-TestEncryptedCinderVolumes-1403131144 tempest-TestEncryptedCinderVolumes-1403131144-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 15:00:44.816570 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-711173a9-a096-4a95-ae10-b0641a6aba4e tempest-TestEncryptedCinderVolumes-1403131144 tempest-TestEncryptedCinderVolumes-1403131144-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 15:00:44.825090 n-d-791503-6 nova-conductor[98843]: ERROR oslo.messaging._drivers.impl_rabbit [-] [fb67aa64-250d-4c34-b696-14a5dd0b49b6] AMQP server on 10.222.0.68:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection May 28 15:00:45.843016 n-d-791503-6 nova-conductor[98843]: INFO oslo.messaging._drivers.impl_rabbit [-] [fb67aa64-250d-4c34-b696-14a5dd0b49b6] Reconnected to AMQP server on 10.222.0.68:5672 via [amqp] client with port 35318. May 28 15:00:53.367733 n-d-791503-6 nova-conductor[98844]: ERROR oslo.messaging._drivers.impl_rabbit [-] [cbd7c90c-b59a-4f8b-992f-d04ba5ad6f9c] AMQP server on 10.222.0.68:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection May 28 15:00:54.384086 n-d-791503-6 nova-conductor[98844]: INFO oslo.messaging._drivers.impl_rabbit [-] [cbd7c90c-b59a-4f8b-992f-d04ba5ad6f9c] Reconnected to AMQP server on 10.222.0.68:5672 via [amqp] client with port 35334. May 28 15:01:25.852837 n-d-791503-6 nova-conductor[98843]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 15:01:58.611702 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-267e2ba7-a93b-4238-a894-9b250f498f48 tempest-TestMinimumBasicScenario-1744320921 tempest-TestMinimumBasicScenario-1744320921-project] Took 0.23 seconds to select destinations for 1 instance(s). {{(pid=98843) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 15:01:58.634539 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-267e2ba7-a93b-4238-a894-9b250f498f48 tempest-TestMinimumBasicScenario-1744320921 tempest-TestMinimumBasicScenario-1744320921-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 15:01:58.634941 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-267e2ba7-a93b-4238-a894-9b250f498f48 tempest-TestMinimumBasicScenario-1744320921 tempest-TestMinimumBasicScenario-1744320921-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 15:01:58.688618 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-267e2ba7-a93b-4238-a894-9b250f498f48 tempest-TestMinimumBasicScenario-1744320921 tempest-TestMinimumBasicScenario-1744320921-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 15:01:58.688937 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-267e2ba7-a93b-4238-a894-9b250f498f48 tempest-TestMinimumBasicScenario-1744320921 tempest-TestMinimumBasicScenario-1744320921-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 15:01:58.689653 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-267e2ba7-a93b-4238-a894-9b250f498f48 tempest-TestMinimumBasicScenario-1744320921 tempest-TestMinimumBasicScenario-1744320921-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 15:01:58.690040 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-267e2ba7-a93b-4238-a894-9b250f498f48 tempest-TestMinimumBasicScenario-1744320921 tempest-TestMinimumBasicScenario-1744320921-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 15:01:58.705434 n-d-791503-6 nova-conductor[98843]: DEBUG nova.quota [None req-267e2ba7-a93b-4238-a894-9b250f498f48 tempest-TestMinimumBasicScenario-1744320921 tempest-TestMinimumBasicScenario-1744320921-project] Getting quotas for project e0f1d3e4bc2f47e181ebdff18bc1237b. Resources: {'cores', 'ram', 'instances'} {{(pid=98843) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 15:01:58.710936 n-d-791503-6 nova-conductor[98843]: DEBUG nova.quota [None req-267e2ba7-a93b-4238-a894-9b250f498f48 tempest-TestMinimumBasicScenario-1744320921 tempest-TestMinimumBasicScenario-1744320921-project] Getting quotas for user ccabbdff2a73458f82bd4b7d0ce72c19 and project e0f1d3e4bc2f47e181ebdff18bc1237b. Resources: {'cores', 'ram', 'instances'} {{(pid=98843) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 15:01:58.721893 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-267e2ba7-a93b-4238-a894-9b250f498f48 tempest-TestMinimumBasicScenario-1744320921 tempest-TestMinimumBasicScenario-1744320921-project] [instance: 2fd30072-5399-4909-969b-a0dc0c18e2ef] Selected host: n-h1-791503-6; Selected node: n-h1-791503-6; Alternates: [('n-h2-791503-6', 'n-h2-791503-6')] {{(pid=98843) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 15:01:58.722854 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-267e2ba7-a93b-4238-a894-9b250f498f48 tempest-TestMinimumBasicScenario-1744320921 tempest-TestMinimumBasicScenario-1744320921-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 15:01:58.723297 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-267e2ba7-a93b-4238-a894-9b250f498f48 tempest-TestMinimumBasicScenario-1744320921 tempest-TestMinimumBasicScenario-1744320921-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 15:01:58.730053 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-267e2ba7-a93b-4238-a894-9b250f498f48 tempest-TestMinimumBasicScenario-1744320921 tempest-TestMinimumBasicScenario-1744320921-project] [instance: 2fd30072-5399-4909-969b-a0dc0c18e2ef] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8350dfe1-66e9-4b39-8b2c-2248b6ae7adf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98843) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 15:01:58.731316 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-267e2ba7-a93b-4238-a894-9b250f498f48 tempest-TestMinimumBasicScenario-1744320921 tempest-TestMinimumBasicScenario-1744320921-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 15:01:58.731716 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-267e2ba7-a93b-4238-a894-9b250f498f48 tempest-TestMinimumBasicScenario-1744320921 tempest-TestMinimumBasicScenario-1744320921-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 15:01:58.760749 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-267e2ba7-a93b-4238-a894-9b250f498f48 tempest-TestMinimumBasicScenario-1744320921 tempest-TestMinimumBasicScenario-1744320921-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 15:01:58.761253 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-267e2ba7-a93b-4238-a894-9b250f498f48 tempest-TestMinimumBasicScenario-1744320921 tempest-TestMinimumBasicScenario-1744320921-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 15:02:53.402723 n-d-791503-6 nova-conductor[98844]: ERROR oslo.messaging._drivers.impl_rabbit [-] [abccac45-5c00-4182-bcd1-fb6828b957ad] AMQP server on 10.222.0.68:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 28 15:02:54.419006 n-d-791503-6 nova-conductor[98844]: INFO oslo.messaging._drivers.impl_rabbit [-] [abccac45-5c00-4182-bcd1-fb6828b957ad] Reconnected to AMQP server on 10.222.0.68:5672 via [amqp] client with port 35814. May 28 15:03:33.161742 n-d-791503-6 nova-conductor[98844]: ERROR oslo.messaging._drivers.impl_rabbit [-] [8840711a-c4c2-4555-9645-ce157ee9cc0d] AMQP server on 10.222.0.68:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 28 15:03:34.186257 n-d-791503-6 nova-conductor[98844]: INFO oslo.messaging._drivers.impl_rabbit [-] [8840711a-c4c2-4555-9645-ce157ee9cc0d] Reconnected to AMQP server on 10.222.0.68:5672 via [amqp] client with port 35830. May 28 15:03:36.513191 n-d-791503-6 nova-conductor[98844]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 15:03:45.843666 n-d-791503-6 nova-conductor[98843]: ERROR oslo.messaging._drivers.impl_rabbit [-] [fb67aa64-250d-4c34-b696-14a5dd0b49b6] AMQP server on 10.222.0.68:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection May 28 15:03:46.860442 n-d-791503-6 nova-conductor[98843]: INFO oslo.messaging._drivers.impl_rabbit [-] [fb67aa64-250d-4c34-b696-14a5dd0b49b6] Reconnected to AMQP server on 10.222.0.68:5672 via [amqp] client with port 35848. May 28 15:03:54.385481 n-d-791503-6 nova-conductor[98844]: ERROR oslo.messaging._drivers.impl_rabbit [-] [cbd7c90c-b59a-4f8b-992f-d04ba5ad6f9c] AMQP server on 10.222.0.68:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection May 28 15:03:55.402117 n-d-791503-6 nova-conductor[98844]: INFO oslo.messaging._drivers.impl_rabbit [-] [cbd7c90c-b59a-4f8b-992f-d04ba5ad6f9c] Reconnected to AMQP server on 10.222.0.68:5672 via [amqp] client with port 35864. May 28 15:04:29.013776 n-d-791503-6 nova-conductor[98843]: ERROR oslo.messaging._drivers.impl_rabbit [-] [eee199a3-5934-45a4-999a-298f0a81318b] AMQP server on 10.222.0.68:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 28 15:04:30.039508 n-d-791503-6 nova-conductor[98843]: INFO oslo.messaging._drivers.impl_rabbit [-] [eee199a3-5934-45a4-999a-298f0a81318b] Reconnected to AMQP server on 10.222.0.68:5672 via [amqp] client with port 35870. May 28 15:04:45.871405 n-d-791503-6 nova-conductor[98843]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 15:04:51.547836 n-d-791503-6 nova-conductor[98843]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4bc4adbd-2091-473e-8e44-b9a43f01ab64] AMQP server on 10.222.0.68:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 28 15:04:52.565900 n-d-791503-6 nova-conductor[98843]: INFO oslo.messaging._drivers.impl_rabbit [-] [4bc4adbd-2091-473e-8e44-b9a43f01ab64] Reconnected to AMQP server on 10.222.0.68:5672 via [amqp] client with port 35876. May 28 15:05:36.932006 n-d-791503-6 nova-conductor[98844]: ERROR oslo.messaging._drivers.impl_rabbit [None req-a22585a8-8cf1-4cfb-9a73-76d01707b239 tempest-TestNetworkAdvancedServerOps-2029936095 tempest-TestNetworkAdvancedServerOps-2029936095-project] [3a6b43b2-a32b-4c5b-93cc-103fb16cb905] AMQP server on 10.222.0.68:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 28 15:05:37.962122 n-d-791503-6 nova-conductor[98844]: INFO oslo.messaging._drivers.impl_rabbit [None req-a22585a8-8cf1-4cfb-9a73-76d01707b239 tempest-TestNetworkAdvancedServerOps-2029936095 tempest-TestNetworkAdvancedServerOps-2029936095-project] [3a6b43b2-a32b-4c5b-93cc-103fb16cb905] Reconnected to AMQP server on 10.222.0.68:5672 via [amqp] client with port 36162. May 28 15:05:40.250403 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.manager [None req-a22585a8-8cf1-4cfb-9a73-76d01707b239 tempest-TestNetworkAdvancedServerOps-2029936095 tempest-TestNetworkAdvancedServerOps-2029936095-project] Took 3.32 seconds to select destinations for 1 instance(s). {{(pid=98844) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 15:05:40.272712 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-a22585a8-8cf1-4cfb-9a73-76d01707b239 tempest-TestNetworkAdvancedServerOps-2029936095 tempest-TestNetworkAdvancedServerOps-2029936095-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 15:05:40.273109 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-a22585a8-8cf1-4cfb-9a73-76d01707b239 tempest-TestNetworkAdvancedServerOps-2029936095 tempest-TestNetworkAdvancedServerOps-2029936095-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 15:05:40.324482 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-a22585a8-8cf1-4cfb-9a73-76d01707b239 tempest-TestNetworkAdvancedServerOps-2029936095 tempest-TestNetworkAdvancedServerOps-2029936095-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 15:05:40.324889 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-a22585a8-8cf1-4cfb-9a73-76d01707b239 tempest-TestNetworkAdvancedServerOps-2029936095 tempest-TestNetworkAdvancedServerOps-2029936095-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 15:05:40.325608 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-a22585a8-8cf1-4cfb-9a73-76d01707b239 tempest-TestNetworkAdvancedServerOps-2029936095 tempest-TestNetworkAdvancedServerOps-2029936095-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 15:05:40.326015 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-a22585a8-8cf1-4cfb-9a73-76d01707b239 tempest-TestNetworkAdvancedServerOps-2029936095 tempest-TestNetworkAdvancedServerOps-2029936095-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 15:05:40.341587 n-d-791503-6 nova-conductor[98844]: DEBUG nova.quota [None req-a22585a8-8cf1-4cfb-9a73-76d01707b239 tempest-TestNetworkAdvancedServerOps-2029936095 tempest-TestNetworkAdvancedServerOps-2029936095-project] Getting quotas for project 01acae6c880344ec8b4d37d6d8064cc5. Resources: {'cores', 'ram', 'instances'} {{(pid=98844) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 15:05:40.345974 n-d-791503-6 nova-conductor[98844]: DEBUG nova.quota [None req-a22585a8-8cf1-4cfb-9a73-76d01707b239 tempest-TestNetworkAdvancedServerOps-2029936095 tempest-TestNetworkAdvancedServerOps-2029936095-project] Getting quotas for user 621785676c7945af9fd8714bf4301e78 and project 01acae6c880344ec8b4d37d6d8064cc5. Resources: {'cores', 'ram', 'instances'} {{(pid=98844) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 15:05:40.356127 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.manager [None req-a22585a8-8cf1-4cfb-9a73-76d01707b239 tempest-TestNetworkAdvancedServerOps-2029936095 tempest-TestNetworkAdvancedServerOps-2029936095-project] [instance: 1941325a-741a-4403-9ea8-2b138f958d6b] Selected host: n-h1-791503-6; Selected node: n-h1-791503-6; Alternates: [('n-h2-791503-6', 'n-h2-791503-6')] {{(pid=98844) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 15:05:40.357023 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-a22585a8-8cf1-4cfb-9a73-76d01707b239 tempest-TestNetworkAdvancedServerOps-2029936095 tempest-TestNetworkAdvancedServerOps-2029936095-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 15:05:40.357422 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-a22585a8-8cf1-4cfb-9a73-76d01707b239 tempest-TestNetworkAdvancedServerOps-2029936095 tempest-TestNetworkAdvancedServerOps-2029936095-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 15:05:40.364339 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.manager [None req-a22585a8-8cf1-4cfb-9a73-76d01707b239 tempest-TestNetworkAdvancedServerOps-2029936095 tempest-TestNetworkAdvancedServerOps-2029936095-project] [instance: 1941325a-741a-4403-9ea8-2b138f958d6b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='64f6036b-99a9-40e4-8963-3cdf66964954',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98844) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 15:05:40.365630 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-a22585a8-8cf1-4cfb-9a73-76d01707b239 tempest-TestNetworkAdvancedServerOps-2029936095 tempest-TestNetworkAdvancedServerOps-2029936095-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 15:05:40.366031 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-a22585a8-8cf1-4cfb-9a73-76d01707b239 tempest-TestNetworkAdvancedServerOps-2029936095 tempest-TestNetworkAdvancedServerOps-2029936095-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 15:05:40.396442 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-a22585a8-8cf1-4cfb-9a73-76d01707b239 tempest-TestNetworkAdvancedServerOps-2029936095 tempest-TestNetworkAdvancedServerOps-2029936095-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 15:05:40.396838 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-a22585a8-8cf1-4cfb-9a73-76d01707b239 tempest-TestNetworkAdvancedServerOps-2029936095 tempest-TestNetworkAdvancedServerOps-2029936095-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 15:05:40.406560 n-d-791503-6 nova-conductor[98844]: ERROR oslo.messaging._drivers.impl_rabbit [None req-a22585a8-8cf1-4cfb-9a73-76d01707b239 tempest-TestNetworkAdvancedServerOps-2029936095 tempest-TestNetworkAdvancedServerOps-2029936095-project] [44592b86-ea23-4a40-8b73-bb4398a5e365] AMQP server on 10.222.0.68:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 28 15:05:41.443242 n-d-791503-6 nova-conductor[98844]: INFO oslo.messaging._drivers.impl_rabbit [None req-a22585a8-8cf1-4cfb-9a73-76d01707b239 tempest-TestNetworkAdvancedServerOps-2029936095 tempest-TestNetworkAdvancedServerOps-2029936095-project] [44592b86-ea23-4a40-8b73-bb4398a5e365] Reconnected to AMQP server on 10.222.0.68:5672 via [amqp] client with port 36184. May 28 15:06:46.861737 n-d-791503-6 nova-conductor[98843]: ERROR oslo.messaging._drivers.impl_rabbit [-] [fb67aa64-250d-4c34-b696-14a5dd0b49b6] AMQP server on 10.222.0.68:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection May 28 15:06:47.877878 n-d-791503-6 nova-conductor[98843]: INFO oslo.messaging._drivers.impl_rabbit [-] [fb67aa64-250d-4c34-b696-14a5dd0b49b6] Reconnected to AMQP server on 10.222.0.68:5672 via [amqp] client with port 36246. May 28 15:06:55.403727 n-d-791503-6 nova-conductor[98844]: ERROR oslo.messaging._drivers.impl_rabbit [-] [cbd7c90c-b59a-4f8b-992f-d04ba5ad6f9c] AMQP server on 10.222.0.68:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection May 28 15:06:56.422767 n-d-791503-6 nova-conductor[98844]: INFO oslo.messaging._drivers.impl_rabbit [-] [cbd7c90c-b59a-4f8b-992f-d04ba5ad6f9c] Reconnected to AMQP server on 10.222.0.68:5672 via [amqp] client with port 36250. May 28 15:06:56.530569 n-d-791503-6 nova-conductor[98844]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 15:07:26.597882 n-d-791503-6 nova-conductor[98843]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 15:07:29.406797 n-d-791503-6 nova-conductor[98843]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 15:07:30.034722 n-d-791503-6 nova-conductor[98843]: ERROR oslo.messaging._drivers.impl_rabbit [-] [eee199a3-5934-45a4-999a-298f0a81318b] AMQP server on 10.222.0.68:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 28 15:07:31.062598 n-d-791503-6 nova-conductor[98843]: INFO oslo.messaging._drivers.impl_rabbit [-] [eee199a3-5934-45a4-999a-298f0a81318b] Reconnected to AMQP server on 10.222.0.68:5672 via [amqp] client with port 36400. May 28 15:07:34.543653 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.manager [None req-616bda95-14f0-410a-9116-18876496b64d tempest-TestNetworkAdvancedServerOps-2029936095 tempest-TestNetworkAdvancedServerOps-2029936095-project] Took 0.34 seconds to select destinations for 1 instance(s). {{(pid=98844) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 15:07:34.570301 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-616bda95-14f0-410a-9116-18876496b64d tempest-TestNetworkAdvancedServerOps-2029936095 tempest-TestNetworkAdvancedServerOps-2029936095-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 15:07:34.570701 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-616bda95-14f0-410a-9116-18876496b64d tempest-TestNetworkAdvancedServerOps-2029936095 tempest-TestNetworkAdvancedServerOps-2029936095-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 15:07:34.617191 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-616bda95-14f0-410a-9116-18876496b64d tempest-TestNetworkAdvancedServerOps-2029936095 tempest-TestNetworkAdvancedServerOps-2029936095-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 15:07:34.617594 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-616bda95-14f0-410a-9116-18876496b64d tempest-TestNetworkAdvancedServerOps-2029936095 tempest-TestNetworkAdvancedServerOps-2029936095-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 15:07:34.618307 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-616bda95-14f0-410a-9116-18876496b64d tempest-TestNetworkAdvancedServerOps-2029936095 tempest-TestNetworkAdvancedServerOps-2029936095-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 15:07:34.618689 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-616bda95-14f0-410a-9116-18876496b64d tempest-TestNetworkAdvancedServerOps-2029936095 tempest-TestNetworkAdvancedServerOps-2029936095-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 15:07:34.634869 n-d-791503-6 nova-conductor[98844]: DEBUG nova.quota [None req-616bda95-14f0-410a-9116-18876496b64d tempest-TestNetworkAdvancedServerOps-2029936095 tempest-TestNetworkAdvancedServerOps-2029936095-project] Getting quotas for project 01acae6c880344ec8b4d37d6d8064cc5. Resources: {'cores', 'ram', 'instances'} {{(pid=98844) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 15:07:34.640036 n-d-791503-6 nova-conductor[98844]: DEBUG nova.quota [None req-616bda95-14f0-410a-9116-18876496b64d tempest-TestNetworkAdvancedServerOps-2029936095 tempest-TestNetworkAdvancedServerOps-2029936095-project] Getting quotas for user 621785676c7945af9fd8714bf4301e78 and project 01acae6c880344ec8b4d37d6d8064cc5. Resources: {'cores', 'ram', 'instances'} {{(pid=98844) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 15:07:34.650321 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.manager [None req-616bda95-14f0-410a-9116-18876496b64d tempest-TestNetworkAdvancedServerOps-2029936095 tempest-TestNetworkAdvancedServerOps-2029936095-project] [instance: e7a75ff1-7ff4-451e-83b3-c487b9367348] Selected host: n-h1-791503-6; Selected node: n-h1-791503-6; Alternates: [('n-h2-791503-6', 'n-h2-791503-6')] {{(pid=98844) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 15:07:34.651336 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-616bda95-14f0-410a-9116-18876496b64d tempest-TestNetworkAdvancedServerOps-2029936095 tempest-TestNetworkAdvancedServerOps-2029936095-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 15:07:34.651777 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-616bda95-14f0-410a-9116-18876496b64d tempest-TestNetworkAdvancedServerOps-2029936095 tempest-TestNetworkAdvancedServerOps-2029936095-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 15:07:34.659883 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.manager [None req-616bda95-14f0-410a-9116-18876496b64d tempest-TestNetworkAdvancedServerOps-2029936095 tempest-TestNetworkAdvancedServerOps-2029936095-project] [instance: e7a75ff1-7ff4-451e-83b3-c487b9367348] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='64f6036b-99a9-40e4-8963-3cdf66964954',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98844) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 15:07:34.661228 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-616bda95-14f0-410a-9116-18876496b64d tempest-TestNetworkAdvancedServerOps-2029936095 tempest-TestNetworkAdvancedServerOps-2029936095-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 15:07:34.661666 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-616bda95-14f0-410a-9116-18876496b64d tempest-TestNetworkAdvancedServerOps-2029936095 tempest-TestNetworkAdvancedServerOps-2029936095-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 15:07:34.691193 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-616bda95-14f0-410a-9116-18876496b64d tempest-TestNetworkAdvancedServerOps-2029936095 tempest-TestNetworkAdvancedServerOps-2029936095-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 15:07:34.691595 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-616bda95-14f0-410a-9116-18876496b64d tempest-TestNetworkAdvancedServerOps-2029936095 tempest-TestNetworkAdvancedServerOps-2029936095-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 15:07:52.566849 n-d-791503-6 nova-conductor[98843]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4bc4adbd-2091-473e-8e44-b9a43f01ab64] AMQP server on 10.222.0.68:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 28 15:07:53.584405 n-d-791503-6 nova-conductor[98843]: INFO oslo.messaging._drivers.impl_rabbit [-] [4bc4adbd-2091-473e-8e44-b9a43f01ab64] Reconnected to AMQP server on 10.222.0.68:5672 via [amqp] client with port 36480. May 28 15:08:05.888111 n-d-791503-6 nova-conductor[98843]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 15:09:47.880247 n-d-791503-6 nova-conductor[98843]: ERROR oslo.messaging._drivers.impl_rabbit [-] [fb67aa64-250d-4c34-b696-14a5dd0b49b6] AMQP server on 10.222.0.68:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection May 28 15:09:48.896259 n-d-791503-6 nova-conductor[98843]: INFO oslo.messaging._drivers.impl_rabbit [-] [fb67aa64-250d-4c34-b696-14a5dd0b49b6] Reconnected to AMQP server on 10.222.0.68:5672 via [amqp] client with port 36540. May 28 15:09:54.424806 n-d-791503-6 nova-conductor[98844]: ERROR oslo.messaging._drivers.impl_rabbit [-] [abccac45-5c00-4182-bcd1-fb6828b957ad] AMQP server on 10.222.0.68:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 28 15:09:55.442118 n-d-791503-6 nova-conductor[98844]: INFO oslo.messaging._drivers.impl_rabbit [-] [abccac45-5c00-4182-bcd1-fb6828b957ad] Reconnected to AMQP server on 10.222.0.68:5672 via [amqp] client with port 36544. May 28 15:09:56.423892 n-d-791503-6 nova-conductor[98844]: ERROR oslo.messaging._drivers.impl_rabbit [-] [cbd7c90c-b59a-4f8b-992f-d04ba5ad6f9c] AMQP server on 10.222.0.68:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 28 15:09:57.440111 n-d-791503-6 nova-conductor[98844]: INFO oslo.messaging._drivers.impl_rabbit [-] [cbd7c90c-b59a-4f8b-992f-d04ba5ad6f9c] Reconnected to AMQP server on 10.222.0.68:5672 via [amqp] client with port 36550. May 28 15:10:16.548363 n-d-791503-6 nova-conductor[98844]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 15:10:24.226135 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-1e37c4ed-bb48-4466-8b4c-93d3029d210a tempest-TestNetworkAdvancedServerOps-2029936095 tempest-TestNetworkAdvancedServerOps-2029936095-project] Took 0.39 seconds to select destinations for 1 instance(s). {{(pid=98843) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 15:10:24.249481 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-1e37c4ed-bb48-4466-8b4c-93d3029d210a tempest-TestNetworkAdvancedServerOps-2029936095 tempest-TestNetworkAdvancedServerOps-2029936095-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 15:10:24.249897 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-1e37c4ed-bb48-4466-8b4c-93d3029d210a tempest-TestNetworkAdvancedServerOps-2029936095 tempest-TestNetworkAdvancedServerOps-2029936095-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 15:10:24.304285 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-1e37c4ed-bb48-4466-8b4c-93d3029d210a tempest-TestNetworkAdvancedServerOps-2029936095 tempest-TestNetworkAdvancedServerOps-2029936095-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 15:10:24.304919 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-1e37c4ed-bb48-4466-8b4c-93d3029d210a tempest-TestNetworkAdvancedServerOps-2029936095 tempest-TestNetworkAdvancedServerOps-2029936095-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 15:10:24.305837 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-1e37c4ed-bb48-4466-8b4c-93d3029d210a tempest-TestNetworkAdvancedServerOps-2029936095 tempest-TestNetworkAdvancedServerOps-2029936095-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 15:10:24.306237 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-1e37c4ed-bb48-4466-8b4c-93d3029d210a tempest-TestNetworkAdvancedServerOps-2029936095 tempest-TestNetworkAdvancedServerOps-2029936095-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 15:10:24.329188 n-d-791503-6 nova-conductor[98843]: DEBUG nova.quota [None req-1e37c4ed-bb48-4466-8b4c-93d3029d210a tempest-TestNetworkAdvancedServerOps-2029936095 tempest-TestNetworkAdvancedServerOps-2029936095-project] Getting quotas for project 01acae6c880344ec8b4d37d6d8064cc5. Resources: {'cores', 'ram', 'instances'} {{(pid=98843) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 15:10:24.334151 n-d-791503-6 nova-conductor[98843]: DEBUG nova.quota [None req-1e37c4ed-bb48-4466-8b4c-93d3029d210a tempest-TestNetworkAdvancedServerOps-2029936095 tempest-TestNetworkAdvancedServerOps-2029936095-project] Getting quotas for user 621785676c7945af9fd8714bf4301e78 and project 01acae6c880344ec8b4d37d6d8064cc5. Resources: {'cores', 'ram', 'instances'} {{(pid=98843) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 15:10:24.345760 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-1e37c4ed-bb48-4466-8b4c-93d3029d210a tempest-TestNetworkAdvancedServerOps-2029936095 tempest-TestNetworkAdvancedServerOps-2029936095-project] [instance: c633ba6b-14b8-44b2-82d5-2b4891f3b118] Selected host: n-h1-791503-6; Selected node: n-h1-791503-6; Alternates: [('n-h2-791503-6', 'n-h2-791503-6')] {{(pid=98843) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 15:10:24.346742 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-1e37c4ed-bb48-4466-8b4c-93d3029d210a tempest-TestNetworkAdvancedServerOps-2029936095 tempest-TestNetworkAdvancedServerOps-2029936095-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 15:10:24.347174 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-1e37c4ed-bb48-4466-8b4c-93d3029d210a tempest-TestNetworkAdvancedServerOps-2029936095 tempest-TestNetworkAdvancedServerOps-2029936095-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 15:10:24.355153 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-1e37c4ed-bb48-4466-8b4c-93d3029d210a tempest-TestNetworkAdvancedServerOps-2029936095 tempest-TestNetworkAdvancedServerOps-2029936095-project] [instance: c633ba6b-14b8-44b2-82d5-2b4891f3b118] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='64f6036b-99a9-40e4-8963-3cdf66964954',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98843) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 15:10:24.356476 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-1e37c4ed-bb48-4466-8b4c-93d3029d210a tempest-TestNetworkAdvancedServerOps-2029936095 tempest-TestNetworkAdvancedServerOps-2029936095-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 15:10:24.357586 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-1e37c4ed-bb48-4466-8b4c-93d3029d210a tempest-TestNetworkAdvancedServerOps-2029936095 tempest-TestNetworkAdvancedServerOps-2029936095-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 15:10:24.393268 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-1e37c4ed-bb48-4466-8b4c-93d3029d210a tempest-TestNetworkAdvancedServerOps-2029936095 tempest-TestNetworkAdvancedServerOps-2029936095-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 15:10:24.393672 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-1e37c4ed-bb48-4466-8b4c-93d3029d210a tempest-TestNetworkAdvancedServerOps-2029936095 tempest-TestNetworkAdvancedServerOps-2029936095-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 15:10:34.185043 n-d-791503-6 nova-conductor[98844]: ERROR oslo.messaging._drivers.impl_rabbit [-] [8840711a-c4c2-4555-9645-ce157ee9cc0d] AMQP server on 10.222.0.68:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 28 15:10:35.210033 n-d-791503-6 nova-conductor[98844]: INFO oslo.messaging._drivers.impl_rabbit [-] [8840711a-c4c2-4555-9645-ce157ee9cc0d] Reconnected to AMQP server on 10.222.0.68:5672 via [amqp] client with port 36714. May 28 15:10:45.345599 n-d-791503-6 nova-conductor[98844]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 15:10:47.954351 n-d-791503-6 nova-conductor[98844]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 15:11:25.910353 n-d-791503-6 nova-conductor[98843]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 15:11:44.946813 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-7b8fa705-18e3-4598-8ae6-3e3061341f12 tempest-TestNetworkAdvancedServerOps-2029936095 tempest-TestNetworkAdvancedServerOps-2029936095-project] Targeting cell b241212c-c279-4fbb-a1e7-b87889287cbf(cell1) for conductor method migrate_server {{(pid=98843) wrapper /opt/stack/nova/nova/conductor/manager.py:91}} May 28 15:11:44.947475 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-7b8fa705-18e3-4598-8ae6-3e3061341f12 tempest-TestNetworkAdvancedServerOps-2029936095 tempest-TestNetworkAdvancedServerOps-2029936095-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 15:11:44.947706 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-7b8fa705-18e3-4598-8ae6-3e3061341f12 tempest-TestNetworkAdvancedServerOps-2029936095 tempest-TestNetworkAdvancedServerOps-2029936095-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 15:11:45.169858 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.tasks.migrate [None req-7b8fa705-18e3-4598-8ae6-3e3061341f12 tempest-TestNetworkAdvancedServerOps-2029936095 tempest-TestNetworkAdvancedServerOps-2029936095-project] [instance: c633ba6b-14b8-44b2-82d5-2b4891f3b118] Restricting to cell b241212c-c279-4fbb-a1e7-b87889287cbf(cell1) while migrating {{(pid=98843) _set_requested_destination_cell /opt/stack/nova/nova/conductor/tasks/migrate.py:208}} May 28 15:11:45.511582 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.tasks.migrate [None req-7b8fa705-18e3-4598-8ae6-3e3061341f12 tempest-TestNetworkAdvancedServerOps-2029936095 tempest-TestNetworkAdvancedServerOps-2029936095-project] Created allocations for migration f9ccc8ff-ecdc-4623-9497-e6437c1a943b on d4341c2e-3ff0-43f5-9b7e-4ec6191a47d4 {{(pid=98843) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} May 28 15:11:45.715489 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.tasks.migrate [None req-7b8fa705-18e3-4598-8ae6-3e3061341f12 tempest-TestNetworkAdvancedServerOps-2029936095 tempest-TestNetworkAdvancedServerOps-2029936095-project] [instance: c633ba6b-14b8-44b2-82d5-2b4891f3b118] Calling prep_resize with selected host: n-h2-791503-6; Selected node: n-h2-791503-6; Alternates: [Selection(allocation_request='{"allocations": {"d4341c2e-3ff0-43f5-9b7e-4ec6191a47d4": {"resources": {"DISK_GB": 1, "MEMORY_MB": 512, "VCPU": 1}}}, "mappings": {"": ["d4341c2e-3ff0-43f5-9b7e-4ec6191a47d4"]}}',allocation_request_version='1.35',availability_zone='nova',cell_uuid=b241212c-c279-4fbb-a1e7-b87889287cbf,compute_node_uuid=d4341c2e-3ff0-43f5-9b7e-4ec6191a47d4,limits=SchedulerLimits,nodename='n-h1-791503-6',service_host='n-h1-791503-6')] {{(pid=98843) _execute /opt/stack/nova/nova/conductor/tasks/migrate.py:315}} May 28 15:12:48.897643 n-d-791503-6 nova-conductor[98843]: ERROR oslo.messaging._drivers.impl_rabbit [-] [fb67aa64-250d-4c34-b696-14a5dd0b49b6] AMQP server on 10.222.0.68:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection May 28 15:12:49.918680 n-d-791503-6 nova-conductor[98843]: INFO oslo.messaging._drivers.impl_rabbit [-] [fb67aa64-250d-4c34-b696-14a5dd0b49b6] Reconnected to AMQP server on 10.222.0.68:5672 via [amqp] client with port 36944. May 28 15:12:55.444310 n-d-791503-6 nova-conductor[98844]: ERROR oslo.messaging._drivers.impl_rabbit [-] [abccac45-5c00-4182-bcd1-fb6828b957ad] AMQP server on 10.222.0.68:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 28 15:12:56.471802 n-d-791503-6 nova-conductor[98844]: INFO oslo.messaging._drivers.impl_rabbit [-] [abccac45-5c00-4182-bcd1-fb6828b957ad] Reconnected to AMQP server on 10.222.0.68:5672 via [amqp] client with port 36966. May 28 15:12:57.442140 n-d-791503-6 nova-conductor[98844]: ERROR oslo.messaging._drivers.impl_rabbit [-] [cbd7c90c-b59a-4f8b-992f-d04ba5ad6f9c] AMQP server on 10.222.0.68:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection May 28 15:12:57.834884 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.manager [None req-d2623a66-1df1-41d7-86a2-6681d7c70b40 tempest-TestNetworkAdvancedServerOps-2029936095 tempest-TestNetworkAdvancedServerOps-2029936095-project] Took 0.33 seconds to select destinations for 1 instance(s). {{(pid=98844) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 15:12:57.861723 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-d2623a66-1df1-41d7-86a2-6681d7c70b40 tempest-TestNetworkAdvancedServerOps-2029936095 tempest-TestNetworkAdvancedServerOps-2029936095-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 15:12:57.862165 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-d2623a66-1df1-41d7-86a2-6681d7c70b40 tempest-TestNetworkAdvancedServerOps-2029936095 tempest-TestNetworkAdvancedServerOps-2029936095-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 15:12:57.921322 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-d2623a66-1df1-41d7-86a2-6681d7c70b40 tempest-TestNetworkAdvancedServerOps-2029936095 tempest-TestNetworkAdvancedServerOps-2029936095-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 15:12:57.921848 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-d2623a66-1df1-41d7-86a2-6681d7c70b40 tempest-TestNetworkAdvancedServerOps-2029936095 tempest-TestNetworkAdvancedServerOps-2029936095-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 15:12:57.922488 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-d2623a66-1df1-41d7-86a2-6681d7c70b40 tempest-TestNetworkAdvancedServerOps-2029936095 tempest-TestNetworkAdvancedServerOps-2029936095-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 15:12:57.922881 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-d2623a66-1df1-41d7-86a2-6681d7c70b40 tempest-TestNetworkAdvancedServerOps-2029936095 tempest-TestNetworkAdvancedServerOps-2029936095-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 15:12:57.939227 n-d-791503-6 nova-conductor[98844]: DEBUG nova.quota [None req-d2623a66-1df1-41d7-86a2-6681d7c70b40 tempest-TestNetworkAdvancedServerOps-2029936095 tempest-TestNetworkAdvancedServerOps-2029936095-project] Getting quotas for project 01acae6c880344ec8b4d37d6d8064cc5. Resources: {'cores', 'ram', 'instances'} {{(pid=98844) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 15:12:57.944749 n-d-791503-6 nova-conductor[98844]: DEBUG nova.quota [None req-d2623a66-1df1-41d7-86a2-6681d7c70b40 tempest-TestNetworkAdvancedServerOps-2029936095 tempest-TestNetworkAdvancedServerOps-2029936095-project] Getting quotas for user 621785676c7945af9fd8714bf4301e78 and project 01acae6c880344ec8b4d37d6d8064cc5. Resources: {'cores', 'ram', 'instances'} {{(pid=98844) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 15:12:57.956968 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.manager [None req-d2623a66-1df1-41d7-86a2-6681d7c70b40 tempest-TestNetworkAdvancedServerOps-2029936095 tempest-TestNetworkAdvancedServerOps-2029936095-project] [instance: 6de6994e-ecf0-4450-889f-d2bffd13c6c3] Selected host: n-h1-791503-6; Selected node: n-h1-791503-6; Alternates: [('n-h2-791503-6', 'n-h2-791503-6')] {{(pid=98844) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 15:12:57.957983 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-d2623a66-1df1-41d7-86a2-6681d7c70b40 tempest-TestNetworkAdvancedServerOps-2029936095 tempest-TestNetworkAdvancedServerOps-2029936095-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 15:12:57.958386 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-d2623a66-1df1-41d7-86a2-6681d7c70b40 tempest-TestNetworkAdvancedServerOps-2029936095 tempest-TestNetworkAdvancedServerOps-2029936095-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 15:12:57.967448 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.manager [None req-d2623a66-1df1-41d7-86a2-6681d7c70b40 tempest-TestNetworkAdvancedServerOps-2029936095 tempest-TestNetworkAdvancedServerOps-2029936095-project] [instance: 6de6994e-ecf0-4450-889f-d2bffd13c6c3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='64f6036b-99a9-40e4-8963-3cdf66964954',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98844) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 15:12:57.968725 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-d2623a66-1df1-41d7-86a2-6681d7c70b40 tempest-TestNetworkAdvancedServerOps-2029936095 tempest-TestNetworkAdvancedServerOps-2029936095-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 15:12:57.969193 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-d2623a66-1df1-41d7-86a2-6681d7c70b40 tempest-TestNetworkAdvancedServerOps-2029936095 tempest-TestNetworkAdvancedServerOps-2029936095-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 15:12:58.000890 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-d2623a66-1df1-41d7-86a2-6681d7c70b40 tempest-TestNetworkAdvancedServerOps-2029936095 tempest-TestNetworkAdvancedServerOps-2029936095-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 15:12:58.001244 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-d2623a66-1df1-41d7-86a2-6681d7c70b40 tempest-TestNetworkAdvancedServerOps-2029936095 tempest-TestNetworkAdvancedServerOps-2029936095-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 15:12:58.460566 n-d-791503-6 nova-conductor[98844]: INFO oslo.messaging._drivers.impl_rabbit [-] [cbd7c90c-b59a-4f8b-992f-d04ba5ad6f9c] Reconnected to AMQP server on 10.222.0.68:5672 via [amqp] client with port 36996. May 28 15:13:36.564860 n-d-791503-6 nova-conductor[98844]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 15:13:53.589339 n-d-791503-6 nova-conductor[98843]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4bc4adbd-2091-473e-8e44-b9a43f01ab64] AMQP server on 10.222.0.68:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 28 15:13:54.606113 n-d-791503-6 nova-conductor[98843]: INFO oslo.messaging._drivers.impl_rabbit [-] [4bc4adbd-2091-473e-8e44-b9a43f01ab64] Reconnected to AMQP server on 10.222.0.68:5672 via [amqp] client with port 37058. May 28 15:14:31.060739 n-d-791503-6 nova-conductor[98843]: ERROR oslo.messaging._drivers.impl_rabbit [-] [eee199a3-5934-45a4-999a-298f0a81318b] AMQP server on 10.222.0.68:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 28 15:14:32.082946 n-d-791503-6 nova-conductor[98843]: INFO oslo.messaging._drivers.impl_rabbit [-] [eee199a3-5934-45a4-999a-298f0a81318b] Reconnected to AMQP server on 10.222.0.68:5672 via [amqp] client with port 37084. May 28 15:14:45.927162 n-d-791503-6 nova-conductor[98843]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 15:15:35.204860 n-d-791503-6 nova-conductor[98844]: ERROR oslo.messaging._drivers.impl_rabbit [-] [8840711a-c4c2-4555-9645-ce157ee9cc0d] AMQP server on 10.222.0.68:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 28 15:15:36.230636 n-d-791503-6 nova-conductor[98844]: INFO oslo.messaging._drivers.impl_rabbit [-] [8840711a-c4c2-4555-9645-ce157ee9cc0d] Reconnected to AMQP server on 10.222.0.68:5672 via [amqp] client with port 37138. May 28 15:15:45.368360 n-d-791503-6 nova-conductor[98844]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 15:15:47.973549 n-d-791503-6 nova-conductor[98844]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 15:15:49.918847 n-d-791503-6 nova-conductor[98843]: ERROR oslo.messaging._drivers.impl_rabbit [-] [fb67aa64-250d-4c34-b696-14a5dd0b49b6] AMQP server on 10.222.0.68:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection May 28 15:15:50.938807 n-d-791503-6 nova-conductor[98843]: INFO oslo.messaging._drivers.impl_rabbit [-] [fb67aa64-250d-4c34-b696-14a5dd0b49b6] Reconnected to AMQP server on 10.222.0.68:5672 via [amqp] client with port 37230. May 28 15:15:56.466636 n-d-791503-6 nova-conductor[98844]: ERROR oslo.messaging._drivers.impl_rabbit [-] [abccac45-5c00-4182-bcd1-fb6828b957ad] AMQP server on 10.222.0.68:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 28 15:15:57.485733 n-d-791503-6 nova-conductor[98844]: INFO oslo.messaging._drivers.impl_rabbit [-] [abccac45-5c00-4182-bcd1-fb6828b957ad] Reconnected to AMQP server on 10.222.0.68:5672 via [amqp] client with port 37256. May 28 15:15:58.461447 n-d-791503-6 nova-conductor[98844]: ERROR oslo.messaging._drivers.impl_rabbit [-] [cbd7c90c-b59a-4f8b-992f-d04ba5ad6f9c] AMQP server on 10.222.0.68:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection May 28 15:15:59.479796 n-d-791503-6 nova-conductor[98844]: INFO oslo.messaging._drivers.impl_rabbit [-] [cbd7c90c-b59a-4f8b-992f-d04ba5ad6f9c] Reconnected to AMQP server on 10.222.0.68:5672 via [amqp] client with port 37284. May 28 15:15:59.535448 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-509cefcd-1c6b-41a7-a5c4-b727dfce0002 tempest-TestNetworkAdvancedServerOps-2029936095 tempest-TestNetworkAdvancedServerOps-2029936095-project] Took 0.38 seconds to select destinations for 1 instance(s). {{(pid=98843) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 15:15:59.560505 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-509cefcd-1c6b-41a7-a5c4-b727dfce0002 tempest-TestNetworkAdvancedServerOps-2029936095 tempest-TestNetworkAdvancedServerOps-2029936095-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 15:15:59.560948 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-509cefcd-1c6b-41a7-a5c4-b727dfce0002 tempest-TestNetworkAdvancedServerOps-2029936095 tempest-TestNetworkAdvancedServerOps-2029936095-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 15:15:59.614310 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-509cefcd-1c6b-41a7-a5c4-b727dfce0002 tempest-TestNetworkAdvancedServerOps-2029936095 tempest-TestNetworkAdvancedServerOps-2029936095-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 15:15:59.614709 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-509cefcd-1c6b-41a7-a5c4-b727dfce0002 tempest-TestNetworkAdvancedServerOps-2029936095 tempest-TestNetworkAdvancedServerOps-2029936095-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 15:15:59.615467 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-509cefcd-1c6b-41a7-a5c4-b727dfce0002 tempest-TestNetworkAdvancedServerOps-2029936095 tempest-TestNetworkAdvancedServerOps-2029936095-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 15:15:59.615858 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-509cefcd-1c6b-41a7-a5c4-b727dfce0002 tempest-TestNetworkAdvancedServerOps-2029936095 tempest-TestNetworkAdvancedServerOps-2029936095-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 15:15:59.634955 n-d-791503-6 nova-conductor[98843]: DEBUG nova.quota [None req-509cefcd-1c6b-41a7-a5c4-b727dfce0002 tempest-TestNetworkAdvancedServerOps-2029936095 tempest-TestNetworkAdvancedServerOps-2029936095-project] Getting quotas for project 01acae6c880344ec8b4d37d6d8064cc5. Resources: {'cores', 'ram', 'instances'} {{(pid=98843) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 15:15:59.640375 n-d-791503-6 nova-conductor[98843]: DEBUG nova.quota [None req-509cefcd-1c6b-41a7-a5c4-b727dfce0002 tempest-TestNetworkAdvancedServerOps-2029936095 tempest-TestNetworkAdvancedServerOps-2029936095-project] Getting quotas for user 621785676c7945af9fd8714bf4301e78 and project 01acae6c880344ec8b4d37d6d8064cc5. Resources: {'cores', 'ram', 'instances'} {{(pid=98843) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 15:15:59.653591 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-509cefcd-1c6b-41a7-a5c4-b727dfce0002 tempest-TestNetworkAdvancedServerOps-2029936095 tempest-TestNetworkAdvancedServerOps-2029936095-project] [instance: 0b0e83c8-061e-4144-b90c-1b7de1d39476] Selected host: n-h1-791503-6; Selected node: n-h1-791503-6; Alternates: [('n-h2-791503-6', 'n-h2-791503-6')] {{(pid=98843) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 15:15:59.654548 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-509cefcd-1c6b-41a7-a5c4-b727dfce0002 tempest-TestNetworkAdvancedServerOps-2029936095 tempest-TestNetworkAdvancedServerOps-2029936095-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 15:15:59.654948 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-509cefcd-1c6b-41a7-a5c4-b727dfce0002 tempest-TestNetworkAdvancedServerOps-2029936095 tempest-TestNetworkAdvancedServerOps-2029936095-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 15:15:59.662914 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-509cefcd-1c6b-41a7-a5c4-b727dfce0002 tempest-TestNetworkAdvancedServerOps-2029936095 tempest-TestNetworkAdvancedServerOps-2029936095-project] [instance: 0b0e83c8-061e-4144-b90c-1b7de1d39476] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='64f6036b-99a9-40e4-8963-3cdf66964954',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98843) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 15:15:59.664296 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-509cefcd-1c6b-41a7-a5c4-b727dfce0002 tempest-TestNetworkAdvancedServerOps-2029936095 tempest-TestNetworkAdvancedServerOps-2029936095-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 15:15:59.664697 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-509cefcd-1c6b-41a7-a5c4-b727dfce0002 tempest-TestNetworkAdvancedServerOps-2029936095 tempest-TestNetworkAdvancedServerOps-2029936095-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 15:15:59.698992 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-509cefcd-1c6b-41a7-a5c4-b727dfce0002 tempest-TestNetworkAdvancedServerOps-2029936095 tempest-TestNetworkAdvancedServerOps-2029936095-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 15:15:59.699851 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-509cefcd-1c6b-41a7-a5c4-b727dfce0002 tempest-TestNetworkAdvancedServerOps-2029936095 tempest-TestNetworkAdvancedServerOps-2029936095-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 15:16:56.581560 n-d-791503-6 nova-conductor[98844]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 15:18:03.444444 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.manager [None req-dcb7e508-99bb-4cfd-a4cd-ad8248d6fcc8 tempest-TestShelveInstance-1870011663 tempest-TestShelveInstance-1870011663-project] Took 0.44 seconds to select destinations for 1 instance(s). {{(pid=98844) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 15:18:03.468379 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-dcb7e508-99bb-4cfd-a4cd-ad8248d6fcc8 tempest-TestShelveInstance-1870011663 tempest-TestShelveInstance-1870011663-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 15:18:03.468942 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-dcb7e508-99bb-4cfd-a4cd-ad8248d6fcc8 tempest-TestShelveInstance-1870011663 tempest-TestShelveInstance-1870011663-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 15:18:03.518920 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-dcb7e508-99bb-4cfd-a4cd-ad8248d6fcc8 tempest-TestShelveInstance-1870011663 tempest-TestShelveInstance-1870011663-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 15:18:03.519361 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-dcb7e508-99bb-4cfd-a4cd-ad8248d6fcc8 tempest-TestShelveInstance-1870011663 tempest-TestShelveInstance-1870011663-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 15:18:03.520078 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-dcb7e508-99bb-4cfd-a4cd-ad8248d6fcc8 tempest-TestShelveInstance-1870011663 tempest-TestShelveInstance-1870011663-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 15:18:03.520466 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-dcb7e508-99bb-4cfd-a4cd-ad8248d6fcc8 tempest-TestShelveInstance-1870011663 tempest-TestShelveInstance-1870011663-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 15:18:03.536579 n-d-791503-6 nova-conductor[98844]: DEBUG nova.quota [None req-dcb7e508-99bb-4cfd-a4cd-ad8248d6fcc8 tempest-TestShelveInstance-1870011663 tempest-TestShelveInstance-1870011663-project] Getting quotas for project 81e1013aeb6344598afd1ccb22c10a6f. Resources: {'cores', 'ram', 'instances'} {{(pid=98844) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 15:18:03.541277 n-d-791503-6 nova-conductor[98844]: DEBUG nova.quota [None req-dcb7e508-99bb-4cfd-a4cd-ad8248d6fcc8 tempest-TestShelveInstance-1870011663 tempest-TestShelveInstance-1870011663-project] Getting quotas for user 3c016753c3c643d6939a15d1a780f34b and project 81e1013aeb6344598afd1ccb22c10a6f. Resources: {'cores', 'ram', 'instances'} {{(pid=98844) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 15:18:03.552334 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.manager [None req-dcb7e508-99bb-4cfd-a4cd-ad8248d6fcc8 tempest-TestShelveInstance-1870011663 tempest-TestShelveInstance-1870011663-project] [instance: d217bdc4-83ac-4aa2-8aea-0d823c91be29] Selected host: n-h1-791503-6; Selected node: n-h1-791503-6; Alternates: [('n-h2-791503-6', 'n-h2-791503-6')] {{(pid=98844) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 15:18:03.553833 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-dcb7e508-99bb-4cfd-a4cd-ad8248d6fcc8 tempest-TestShelveInstance-1870011663 tempest-TestShelveInstance-1870011663-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 15:18:03.554265 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-dcb7e508-99bb-4cfd-a4cd-ad8248d6fcc8 tempest-TestShelveInstance-1870011663 tempest-TestShelveInstance-1870011663-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 15:18:03.561098 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.manager [None req-dcb7e508-99bb-4cfd-a4cd-ad8248d6fcc8 tempest-TestShelveInstance-1870011663 tempest-TestShelveInstance-1870011663-project] [instance: d217bdc4-83ac-4aa2-8aea-0d823c91be29] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='64f6036b-99a9-40e4-8963-3cdf66964954',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98844) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 15:18:03.562327 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-dcb7e508-99bb-4cfd-a4cd-ad8248d6fcc8 tempest-TestShelveInstance-1870011663 tempest-TestShelveInstance-1870011663-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 15:18:03.562725 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-dcb7e508-99bb-4cfd-a4cd-ad8248d6fcc8 tempest-TestShelveInstance-1870011663 tempest-TestShelveInstance-1870011663-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 15:18:03.592479 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-dcb7e508-99bb-4cfd-a4cd-ad8248d6fcc8 tempest-TestShelveInstance-1870011663 tempest-TestShelveInstance-1870011663-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 15:18:03.592923 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-dcb7e508-99bb-4cfd-a4cd-ad8248d6fcc8 tempest-TestShelveInstance-1870011663 tempest-TestShelveInstance-1870011663-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 15:18:05.944203 n-d-791503-6 nova-conductor[98843]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 15:18:32.079926 n-d-791503-6 nova-conductor[98843]: ERROR oslo.messaging._drivers.impl_rabbit [-] [eee199a3-5934-45a4-999a-298f0a81318b] AMQP server on 10.222.0.68:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 28 15:18:33.106028 n-d-791503-6 nova-conductor[98843]: INFO oslo.messaging._drivers.impl_rabbit [-] [eee199a3-5934-45a4-999a-298f0a81318b] Reconnected to AMQP server on 10.222.0.68:5672 via [amqp] client with port 37642. May 28 15:18:50.938451 n-d-791503-6 nova-conductor[98843]: ERROR oslo.messaging._drivers.impl_rabbit [-] [fb67aa64-250d-4c34-b696-14a5dd0b49b6] AMQP server on 10.222.0.68:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection May 28 15:18:51.970064 n-d-791503-6 nova-conductor[98843]: INFO oslo.messaging._drivers.impl_rabbit [-] [fb67aa64-250d-4c34-b696-14a5dd0b49b6] Reconnected to AMQP server on 10.222.0.68:5672 via [amqp] client with port 37650. May 28 15:18:54.609486 n-d-791503-6 nova-conductor[98843]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4bc4adbd-2091-473e-8e44-b9a43f01ab64] AMQP server on 10.222.0.68:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 28 15:18:55.626160 n-d-791503-6 nova-conductor[98843]: INFO oslo.messaging._drivers.impl_rabbit [-] [4bc4adbd-2091-473e-8e44-b9a43f01ab64] Reconnected to AMQP server on 10.222.0.68:5672 via [amqp] client with port 37652. May 28 15:18:59.480640 n-d-791503-6 nova-conductor[98844]: ERROR oslo.messaging._drivers.impl_rabbit [-] [cbd7c90c-b59a-4f8b-992f-d04ba5ad6f9c] AMQP server on 10.222.0.68:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection May 28 15:19:00.497549 n-d-791503-6 nova-conductor[98844]: INFO oslo.messaging._drivers.impl_rabbit [-] [cbd7c90c-b59a-4f8b-992f-d04ba5ad6f9c] Reconnected to AMQP server on 10.222.0.68:5672 via [amqp] client with port 37656. May 28 15:19:06.622859 n-d-791503-6 nova-conductor[98843]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 15:19:09.433825 n-d-791503-6 nova-conductor[98843]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 15:20:16.598295 n-d-791503-6 nova-conductor[98844]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 15:20:36.226146 n-d-791503-6 nova-conductor[98844]: ERROR oslo.messaging._drivers.impl_rabbit [-] [8840711a-c4c2-4555-9645-ce157ee9cc0d] AMQP server on 10.222.0.68:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 28 15:20:37.248558 n-d-791503-6 nova-conductor[98844]: INFO oslo.messaging._drivers.impl_rabbit [-] [8840711a-c4c2-4555-9645-ce157ee9cc0d] Reconnected to AMQP server on 10.222.0.68:5672 via [amqp] client with port 37684. May 28 15:20:45.392285 n-d-791503-6 nova-conductor[98844]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 15:20:47.995559 n-d-791503-6 nova-conductor[98844]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 15:20:57.486721 n-d-791503-6 nova-conductor[98844]: ERROR oslo.messaging._drivers.impl_rabbit [-] [abccac45-5c00-4182-bcd1-fb6828b957ad] AMQP server on 10.222.0.68:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 28 15:20:58.502347 n-d-791503-6 nova-conductor[98844]: INFO oslo.messaging._drivers.impl_rabbit [-] [abccac45-5c00-4182-bcd1-fb6828b957ad] Reconnected to AMQP server on 10.222.0.68:5672 via [amqp] client with port 37742. May 28 15:21:17.439130 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-0f054064-0c8f-4ae4-bbd1-ecf325758109 tempest-TestShelveInstance-1870011663 tempest-TestShelveInstance-1870011663-project] Targeting cell b241212c-c279-4fbb-a1e7-b87889287cbf(cell1) for conductor method unshelve_instance {{(pid=98843) wrapper /opt/stack/nova/nova/conductor/manager.py:91}} May 28 15:21:17.439647 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-0f054064-0c8f-4ae4-bbd1-ecf325758109 tempest-TestShelveInstance-1870011663 tempest-TestShelveInstance-1870011663-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 15:21:17.439877 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-0f054064-0c8f-4ae4-bbd1-ecf325758109 tempest-TestShelveInstance-1870011663 tempest-TestShelveInstance-1870011663-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 15:21:17.724612 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-0f054064-0c8f-4ae4-bbd1-ecf325758109 tempest-TestShelveInstance-1870011663 tempest-TestShelveInstance-1870011663-project] [instance: d217bdc4-83ac-4aa2-8aea-0d823c91be29] Requesting cell b241212c-c279-4fbb-a1e7-b87889287cbf(cell1) during scheduling {{(pid=98843) _restrict_request_spec_to_cell /opt/stack/nova/nova/conductor/manager.py:902}} May 28 15:21:18.105617 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-0f054064-0c8f-4ae4-bbd1-ecf325758109 tempest-TestShelveInstance-1870011663 tempest-TestShelveInstance-1870011663-project] Took 0.38 seconds to select destinations for 1 instance(s). {{(pid=98843) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 15:21:18.116811 n-d-791503-6 nova-conductor[98843]: DEBUG nova.objects.instance [None req-0f054064-0c8f-4ae4-bbd1-ecf325758109 tempest-TestShelveInstance-1870011663 tempest-TestShelveInstance-1870011663-project] Lazy-loading 'flavor' on Instance uuid d217bdc4-83ac-4aa2-8aea-0d823c91be29 {{(pid=98843) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 28 15:21:25.969463 n-d-791503-6 nova-conductor[98843]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 15:21:51.970401 n-d-791503-6 nova-conductor[98843]: ERROR oslo.messaging._drivers.impl_rabbit [-] [fb67aa64-250d-4c34-b696-14a5dd0b49b6] AMQP server on 10.222.0.68:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection May 28 15:21:52.986191 n-d-791503-6 nova-conductor[98843]: INFO oslo.messaging._drivers.impl_rabbit [-] [fb67aa64-250d-4c34-b696-14a5dd0b49b6] Reconnected to AMQP server on 10.222.0.68:5672 via [amqp] client with port 37980. May 28 15:22:00.498803 n-d-791503-6 nova-conductor[98844]: ERROR oslo.messaging._drivers.impl_rabbit [-] [cbd7c90c-b59a-4f8b-992f-d04ba5ad6f9c] AMQP server on 10.222.0.68:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection May 28 15:22:01.517479 n-d-791503-6 nova-conductor[98844]: INFO oslo.messaging._drivers.impl_rabbit [-] [cbd7c90c-b59a-4f8b-992f-d04ba5ad6f9c] Reconnected to AMQP server on 10.222.0.68:5672 via [amqp] client with port 37982. May 28 15:23:33.101853 n-d-791503-6 nova-conductor[98843]: ERROR oslo.messaging._drivers.impl_rabbit [-] [eee199a3-5934-45a4-999a-298f0a81318b] AMQP server on 10.222.0.68:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 28 15:23:34.132999 n-d-791503-6 nova-conductor[98843]: INFO oslo.messaging._drivers.impl_rabbit [-] [eee199a3-5934-45a4-999a-298f0a81318b] Reconnected to AMQP server on 10.222.0.68:5672 via [amqp] client with port 38022. May 28 15:23:36.614906 n-d-791503-6 nova-conductor[98844]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 15:23:37.244037 n-d-791503-6 nova-conductor[98844]: ERROR oslo.messaging._drivers.impl_rabbit [-] [8840711a-c4c2-4555-9645-ce157ee9cc0d] AMQP server on 10.222.0.68:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 28 15:23:38.270911 n-d-791503-6 nova-conductor[98844]: INFO oslo.messaging._drivers.impl_rabbit [-] [8840711a-c4c2-4555-9645-ce157ee9cc0d] Reconnected to AMQP server on 10.222.0.68:5672 via [amqp] client with port 38044. May 28 15:23:55.629970 n-d-791503-6 nova-conductor[98843]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4bc4adbd-2091-473e-8e44-b9a43f01ab64] AMQP server on 10.222.0.68:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 28 15:23:56.647268 n-d-791503-6 nova-conductor[98843]: INFO oslo.messaging._drivers.impl_rabbit [-] [4bc4adbd-2091-473e-8e44-b9a43f01ab64] Reconnected to AMQP server on 10.222.0.68:5672 via [amqp] client with port 38228. May 28 15:23:58.121857 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-78eaaa04-e1fd-4eaa-a965-3cd08b28846c tempest-TestShelveInstance-1870011663 tempest-TestShelveInstance-1870011663-project] Took 2.45 seconds to select destinations for 1 instance(s). {{(pid=98843) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 15:23:58.145246 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-78eaaa04-e1fd-4eaa-a965-3cd08b28846c tempest-TestShelveInstance-1870011663 tempest-TestShelveInstance-1870011663-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 15:23:58.145646 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-78eaaa04-e1fd-4eaa-a965-3cd08b28846c tempest-TestShelveInstance-1870011663 tempest-TestShelveInstance-1870011663-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 15:23:58.187968 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-78eaaa04-e1fd-4eaa-a965-3cd08b28846c tempest-TestShelveInstance-1870011663 tempest-TestShelveInstance-1870011663-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 15:23:58.188372 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-78eaaa04-e1fd-4eaa-a965-3cd08b28846c tempest-TestShelveInstance-1870011663 tempest-TestShelveInstance-1870011663-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 15:23:58.189099 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-78eaaa04-e1fd-4eaa-a965-3cd08b28846c tempest-TestShelveInstance-1870011663 tempest-TestShelveInstance-1870011663-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 15:23:58.189494 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-78eaaa04-e1fd-4eaa-a965-3cd08b28846c tempest-TestShelveInstance-1870011663 tempest-TestShelveInstance-1870011663-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 15:23:58.205550 n-d-791503-6 nova-conductor[98843]: DEBUG nova.quota [None req-78eaaa04-e1fd-4eaa-a965-3cd08b28846c tempest-TestShelveInstance-1870011663 tempest-TestShelveInstance-1870011663-project] Getting quotas for project 81e1013aeb6344598afd1ccb22c10a6f. Resources: {'cores', 'ram', 'instances'} {{(pid=98843) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 15:23:58.209936 n-d-791503-6 nova-conductor[98843]: DEBUG nova.quota [None req-78eaaa04-e1fd-4eaa-a965-3cd08b28846c tempest-TestShelveInstance-1870011663 tempest-TestShelveInstance-1870011663-project] Getting quotas for user 3c016753c3c643d6939a15d1a780f34b and project 81e1013aeb6344598afd1ccb22c10a6f. Resources: {'cores', 'ram', 'instances'} {{(pid=98843) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 15:23:58.221685 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-78eaaa04-e1fd-4eaa-a965-3cd08b28846c tempest-TestShelveInstance-1870011663 tempest-TestShelveInstance-1870011663-project] [instance: e5081586-eda4-4407-94fb-f10ad2710888] Selected host: n-h2-791503-6; Selected node: n-h2-791503-6; Alternates: [('n-h1-791503-6', 'n-h1-791503-6')] {{(pid=98843) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 15:23:58.222690 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-78eaaa04-e1fd-4eaa-a965-3cd08b28846c tempest-TestShelveInstance-1870011663 tempest-TestShelveInstance-1870011663-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 15:23:58.223119 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-78eaaa04-e1fd-4eaa-a965-3cd08b28846c tempest-TestShelveInstance-1870011663 tempest-TestShelveInstance-1870011663-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 15:23:58.229636 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-78eaaa04-e1fd-4eaa-a965-3cd08b28846c tempest-TestShelveInstance-1870011663 tempest-TestShelveInstance-1870011663-project] [instance: e5081586-eda4-4407-94fb-f10ad2710888] block_device_mapping [BlockDeviceMapping(attachment_id=307c4cba-4ad9-44fe-918a-170c9d1adc79,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='4c030e12-faf5-4115-a7c2-c29a5e9d313e',volume_size=1,volume_type=None)] {{(pid=98843) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 15:23:58.230983 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-78eaaa04-e1fd-4eaa-a965-3cd08b28846c tempest-TestShelveInstance-1870011663 tempest-TestShelveInstance-1870011663-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 15:23:58.231410 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-78eaaa04-e1fd-4eaa-a965-3cd08b28846c tempest-TestShelveInstance-1870011663 tempest-TestShelveInstance-1870011663-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 15:23:58.261586 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-78eaaa04-e1fd-4eaa-a965-3cd08b28846c tempest-TestShelveInstance-1870011663 tempest-TestShelveInstance-1870011663-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 15:23:58.262165 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-78eaaa04-e1fd-4eaa-a965-3cd08b28846c tempest-TestShelveInstance-1870011663 tempest-TestShelveInstance-1870011663-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 15:23:58.503807 n-d-791503-6 nova-conductor[98844]: ERROR oslo.messaging._drivers.impl_rabbit [-] [abccac45-5c00-4182-bcd1-fb6828b957ad] AMQP server on 10.222.0.68:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 28 15:23:59.521513 n-d-791503-6 nova-conductor[98844]: INFO oslo.messaging._drivers.impl_rabbit [-] [abccac45-5c00-4182-bcd1-fb6828b957ad] Reconnected to AMQP server on 10.222.0.68:5672 via [amqp] client with port 38252. May 28 15:24:05.409786 n-d-791503-6 nova-conductor[98844]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 15:24:08.015517 n-d-791503-6 nova-conductor[98844]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 15:24:45.989528 n-d-791503-6 nova-conductor[98843]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 15:24:52.987575 n-d-791503-6 nova-conductor[98843]: ERROR oslo.messaging._drivers.impl_rabbit [-] [fb67aa64-250d-4c34-b696-14a5dd0b49b6] AMQP server on 10.222.0.68:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection May 28 15:24:54.004526 n-d-791503-6 nova-conductor[98843]: INFO oslo.messaging._drivers.impl_rabbit [-] [fb67aa64-250d-4c34-b696-14a5dd0b49b6] Reconnected to AMQP server on 10.222.0.68:5672 via [amqp] client with port 38334. May 28 15:25:01.516532 n-d-791503-6 nova-conductor[98844]: ERROR oslo.messaging._drivers.impl_rabbit [-] [cbd7c90c-b59a-4f8b-992f-d04ba5ad6f9c] AMQP server on 10.222.0.68:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection May 28 15:25:02.532121 n-d-791503-6 nova-conductor[98844]: INFO oslo.messaging._drivers.impl_rabbit [-] [cbd7c90c-b59a-4f8b-992f-d04ba5ad6f9c] Reconnected to AMQP server on 10.222.0.68:5672 via [amqp] client with port 38336. May 28 15:26:29.904444 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.manager [None req-9e94a7b2-de02-4e4a-bf06-30f6588d8e57 tempest-TestShelveInstance-1870011663 tempest-TestShelveInstance-1870011663-project] Targeting cell b241212c-c279-4fbb-a1e7-b87889287cbf(cell1) for conductor method unshelve_instance {{(pid=98844) wrapper /opt/stack/nova/nova/conductor/manager.py:91}} May 28 15:26:29.905914 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-9e94a7b2-de02-4e4a-bf06-30f6588d8e57 tempest-TestShelveInstance-1870011663 tempest-TestShelveInstance-1870011663-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 15:26:29.905914 n-d-791503-6 nova-conductor[98844]: DEBUG oslo_concurrency.lockutils [None req-9e94a7b2-de02-4e4a-bf06-30f6588d8e57 tempest-TestShelveInstance-1870011663 tempest-TestShelveInstance-1870011663-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 15:26:30.101489 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.manager [None req-9e94a7b2-de02-4e4a-bf06-30f6588d8e57 tempest-TestShelveInstance-1870011663 tempest-TestShelveInstance-1870011663-project] [instance: e5081586-eda4-4407-94fb-f10ad2710888] Requesting cell b241212c-c279-4fbb-a1e7-b87889287cbf(cell1) during scheduling {{(pid=98844) _restrict_request_spec_to_cell /opt/stack/nova/nova/conductor/manager.py:902}} May 28 15:26:30.432582 n-d-791503-6 nova-conductor[98844]: DEBUG nova.conductor.manager [None req-9e94a7b2-de02-4e4a-bf06-30f6588d8e57 tempest-TestShelveInstance-1870011663 tempest-TestShelveInstance-1870011663-project] Took 0.33 seconds to select destinations for 1 instance(s). {{(pid=98844) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 15:26:30.445416 n-d-791503-6 nova-conductor[98844]: DEBUG nova.objects.instance [None req-9e94a7b2-de02-4e4a-bf06-30f6588d8e57 tempest-TestShelveInstance-1870011663 tempest-TestShelveInstance-1870011663-project] Lazy-loading 'flavor' on Instance uuid e5081586-eda4-4407-94fb-f10ad2710888 {{(pid=98844) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 28 15:26:34.124826 n-d-791503-6 nova-conductor[98843]: ERROR oslo.messaging._drivers.impl_rabbit [-] [eee199a3-5934-45a4-999a-298f0a81318b] AMQP server on 10.222.0.68:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 28 15:26:35.149676 n-d-791503-6 nova-conductor[98843]: INFO oslo.messaging._drivers.impl_rabbit [-] [eee199a3-5934-45a4-999a-298f0a81318b] Reconnected to AMQP server on 10.222.0.68:5672 via [amqp] client with port 38406. May 28 15:26:56.635081 n-d-791503-6 nova-conductor[98844]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 15:26:56.648729 n-d-791503-6 nova-conductor[98843]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4bc4adbd-2091-473e-8e44-b9a43f01ab64] AMQP server on 10.222.0.68:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 28 15:26:57.665467 n-d-791503-6 nova-conductor[98843]: INFO oslo.messaging._drivers.impl_rabbit [-] [4bc4adbd-2091-473e-8e44-b9a43f01ab64] Reconnected to AMQP server on 10.222.0.68:5672 via [amqp] client with port 38452. May 28 15:27:54.005901 n-d-791503-6 nova-conductor[98843]: ERROR oslo.messaging._drivers.impl_rabbit [-] [fb67aa64-250d-4c34-b696-14a5dd0b49b6] AMQP server on 10.222.0.68:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection May 28 15:27:55.022024 n-d-791503-6 nova-conductor[98843]: INFO oslo.messaging._drivers.impl_rabbit [-] [fb67aa64-250d-4c34-b696-14a5dd0b49b6] Reconnected to AMQP server on 10.222.0.68:5672 via [amqp] client with port 38464. May 28 15:28:02.533452 n-d-791503-6 nova-conductor[98844]: ERROR oslo.messaging._drivers.impl_rabbit [-] [cbd7c90c-b59a-4f8b-992f-d04ba5ad6f9c] AMQP server on 10.222.0.68:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection May 28 15:28:03.550070 n-d-791503-6 nova-conductor[98844]: INFO oslo.messaging._drivers.impl_rabbit [-] [cbd7c90c-b59a-4f8b-992f-d04ba5ad6f9c] Reconnected to AMQP server on 10.222.0.68:5672 via [amqp] client with port 38466. May 28 15:28:06.006598 n-d-791503-6 nova-conductor[98843]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 15:28:38.267817 n-d-791503-6 nova-conductor[98844]: ERROR oslo.messaging._drivers.impl_rabbit [-] [8840711a-c4c2-4555-9645-ce157ee9cc0d] AMQP server on 10.222.0.68:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 28 15:28:39.292543 n-d-791503-6 nova-conductor[98844]: INFO oslo.messaging._drivers.impl_rabbit [-] [8840711a-c4c2-4555-9645-ce157ee9cc0d] Reconnected to AMQP server on 10.222.0.68:5672 via [amqp] client with port 38630. May 28 15:28:48.563307 n-d-791503-6 nova-conductor[98843]: ERROR oslo.messaging._drivers.impl_rabbit [None req-31b6f0fd-ce67-4ed6-9e87-22412f861c0e tempest-TestSnapshotPattern-1022358684 tempest-TestSnapshotPattern-1022358684-project] [bdcda531-d598-424e-8dcd-ab215e26c83b] AMQP server on 10.222.0.68:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 28 15:28:49.580792 n-d-791503-6 nova-conductor[98843]: INFO oslo.messaging._drivers.impl_rabbit [None req-31b6f0fd-ce67-4ed6-9e87-22412f861c0e tempest-TestSnapshotPattern-1022358684 tempest-TestSnapshotPattern-1022358684-project] [bdcda531-d598-424e-8dcd-ab215e26c83b] Reconnected to AMQP server on 10.222.0.68:5672 via [amqp] client with port 38684. May 28 15:28:51.861171 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-31b6f0fd-ce67-4ed6-9e87-22412f861c0e tempest-TestSnapshotPattern-1022358684 tempest-TestSnapshotPattern-1022358684-project] Took 3.30 seconds to select destinations for 1 instance(s). {{(pid=98843) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 15:28:51.890072 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-31b6f0fd-ce67-4ed6-9e87-22412f861c0e tempest-TestSnapshotPattern-1022358684 tempest-TestSnapshotPattern-1022358684-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 15:28:51.890345 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-31b6f0fd-ce67-4ed6-9e87-22412f861c0e tempest-TestSnapshotPattern-1022358684 tempest-TestSnapshotPattern-1022358684-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 15:28:51.941132 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-31b6f0fd-ce67-4ed6-9e87-22412f861c0e tempest-TestSnapshotPattern-1022358684 tempest-TestSnapshotPattern-1022358684-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 15:28:51.941521 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-31b6f0fd-ce67-4ed6-9e87-22412f861c0e tempest-TestSnapshotPattern-1022358684 tempest-TestSnapshotPattern-1022358684-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 15:28:51.942230 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-31b6f0fd-ce67-4ed6-9e87-22412f861c0e tempest-TestSnapshotPattern-1022358684 tempest-TestSnapshotPattern-1022358684-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 15:28:51.942609 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-31b6f0fd-ce67-4ed6-9e87-22412f861c0e tempest-TestSnapshotPattern-1022358684 tempest-TestSnapshotPattern-1022358684-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 15:28:51.958369 n-d-791503-6 nova-conductor[98843]: DEBUG nova.quota [None req-31b6f0fd-ce67-4ed6-9e87-22412f861c0e tempest-TestSnapshotPattern-1022358684 tempest-TestSnapshotPattern-1022358684-project] Getting quotas for project e58eab11c0904950bcba9fb794134ad2. Resources: {'cores', 'ram', 'instances'} {{(pid=98843) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 15:28:51.962975 n-d-791503-6 nova-conductor[98843]: DEBUG nova.quota [None req-31b6f0fd-ce67-4ed6-9e87-22412f861c0e tempest-TestSnapshotPattern-1022358684 tempest-TestSnapshotPattern-1022358684-project] Getting quotas for user 08e010f44bdf44bcae9ca9e7aa8561f0 and project e58eab11c0904950bcba9fb794134ad2. Resources: {'cores', 'ram', 'instances'} {{(pid=98843) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 15:28:51.974190 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-31b6f0fd-ce67-4ed6-9e87-22412f861c0e tempest-TestSnapshotPattern-1022358684 tempest-TestSnapshotPattern-1022358684-project] [instance: 805cb745-a675-4767-8550-48dc26710b6b] Selected host: n-h1-791503-6; Selected node: n-h1-791503-6; Alternates: [('n-h2-791503-6', 'n-h2-791503-6')] {{(pid=98843) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 15:28:51.975156 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-31b6f0fd-ce67-4ed6-9e87-22412f861c0e tempest-TestSnapshotPattern-1022358684 tempest-TestSnapshotPattern-1022358684-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 15:28:51.975697 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-31b6f0fd-ce67-4ed6-9e87-22412f861c0e tempest-TestSnapshotPattern-1022358684 tempest-TestSnapshotPattern-1022358684-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 15:28:51.983244 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-31b6f0fd-ce67-4ed6-9e87-22412f861c0e tempest-TestSnapshotPattern-1022358684 tempest-TestSnapshotPattern-1022358684-project] [instance: 805cb745-a675-4767-8550-48dc26710b6b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='64f6036b-99a9-40e4-8963-3cdf66964954',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98843) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 15:28:51.984447 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-31b6f0fd-ce67-4ed6-9e87-22412f861c0e tempest-TestSnapshotPattern-1022358684 tempest-TestSnapshotPattern-1022358684-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 15:28:51.984839 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-31b6f0fd-ce67-4ed6-9e87-22412f861c0e tempest-TestSnapshotPattern-1022358684 tempest-TestSnapshotPattern-1022358684-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 15:28:52.016593 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-31b6f0fd-ce67-4ed6-9e87-22412f861c0e tempest-TestSnapshotPattern-1022358684 tempest-TestSnapshotPattern-1022358684-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 15:28:52.016984 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-31b6f0fd-ce67-4ed6-9e87-22412f861c0e tempest-TestSnapshotPattern-1022358684 tempest-TestSnapshotPattern-1022358684-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 15:28:52.027625 n-d-791503-6 nova-conductor[98843]: ERROR oslo.messaging._drivers.impl_rabbit [None req-31b6f0fd-ce67-4ed6-9e87-22412f861c0e tempest-TestSnapshotPattern-1022358684 tempest-TestSnapshotPattern-1022358684-project] [9282344d-1714-453f-af6a-f153528668cb] AMQP server on 10.222.0.68:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 28 15:28:53.044493 n-d-791503-6 nova-conductor[98843]: INFO oslo.messaging._drivers.impl_rabbit [None req-31b6f0fd-ce67-4ed6-9e87-22412f861c0e tempest-TestSnapshotPattern-1022358684 tempest-TestSnapshotPattern-1022358684-project] [9282344d-1714-453f-af6a-f153528668cb] Reconnected to AMQP server on 10.222.0.68:5672 via [amqp] client with port 38704. May 28 15:28:59.524568 n-d-791503-6 nova-conductor[98844]: ERROR oslo.messaging._drivers.impl_rabbit [-] [abccac45-5c00-4182-bcd1-fb6828b957ad] AMQP server on 10.222.0.68:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 28 15:29:00.541408 n-d-791503-6 nova-conductor[98844]: INFO oslo.messaging._drivers.impl_rabbit [-] [abccac45-5c00-4182-bcd1-fb6828b957ad] Reconnected to AMQP server on 10.222.0.68:5672 via [amqp] client with port 38722. May 28 15:29:05.428361 n-d-791503-6 nova-conductor[98844]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection May 28 15:29:08.034648 n-d-791503-6 nova-conductor[98844]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 15:30:16.652721 n-d-791503-6 nova-conductor[98844]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 15:30:55.023601 n-d-791503-6 nova-conductor[98843]: ERROR oslo.messaging._drivers.impl_rabbit [-] [fb67aa64-250d-4c34-b696-14a5dd0b49b6] AMQP server on 10.222.0.68:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection May 28 15:30:56.040271 n-d-791503-6 nova-conductor[98843]: INFO oslo.messaging._drivers.impl_rabbit [-] [fb67aa64-250d-4c34-b696-14a5dd0b49b6] Reconnected to AMQP server on 10.222.0.68:5672 via [amqp] client with port 38794. May 28 15:30:57.667686 n-d-791503-6 nova-conductor[98843]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4bc4adbd-2091-473e-8e44-b9a43f01ab64] AMQP server on 10.222.0.68:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 28 15:30:58.683285 n-d-791503-6 nova-conductor[98843]: INFO oslo.messaging._drivers.impl_rabbit [-] [4bc4adbd-2091-473e-8e44-b9a43f01ab64] Reconnected to AMQP server on 10.222.0.68:5672 via [amqp] client with port 38798. May 28 15:31:03.551562 n-d-791503-6 nova-conductor[98844]: ERROR oslo.messaging._drivers.impl_rabbit [-] [cbd7c90c-b59a-4f8b-992f-d04ba5ad6f9c] AMQP server on 10.222.0.68:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection May 28 15:31:04.567177 n-d-791503-6 nova-conductor[98844]: INFO oslo.messaging._drivers.impl_rabbit [-] [cbd7c90c-b59a-4f8b-992f-d04ba5ad6f9c] Reconnected to AMQP server on 10.222.0.68:5672 via [amqp] client with port 38800. May 28 15:31:26.024087 n-d-791503-6 nova-conductor[98843]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 15:31:35.145738 n-d-791503-6 nova-conductor[98843]: ERROR oslo.messaging._drivers.impl_rabbit [-] [eee199a3-5934-45a4-999a-298f0a81318b] AMQP server on 10.222.0.68:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 28 15:31:36.168195 n-d-791503-6 nova-conductor[98843]: INFO oslo.messaging._drivers.impl_rabbit [-] [eee199a3-5934-45a4-999a-298f0a81318b] Reconnected to AMQP server on 10.222.0.68:5672 via [amqp] client with port 38818. May 28 15:31:39.286913 n-d-791503-6 nova-conductor[98844]: ERROR oslo.messaging._drivers.impl_rabbit [-] [8840711a-c4c2-4555-9645-ce157ee9cc0d] AMQP server on 10.222.0.68:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 28 15:31:40.310725 n-d-791503-6 nova-conductor[98844]: INFO oslo.messaging._drivers.impl_rabbit [-] [8840711a-c4c2-4555-9645-ce157ee9cc0d] Reconnected to AMQP server on 10.222.0.68:5672 via [amqp] client with port 38848. May 28 15:31:58.586257 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-50f37717-7406-42a3-a2f3-93eb9712e025 tempest-TestSnapshotPattern-1022358684 tempest-TestSnapshotPattern-1022358684-project] Took 0.31 seconds to select destinations for 1 instance(s). {{(pid=98843) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 15:31:58.615508 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-50f37717-7406-42a3-a2f3-93eb9712e025 tempest-TestSnapshotPattern-1022358684 tempest-TestSnapshotPattern-1022358684-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 15:31:58.616258 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-50f37717-7406-42a3-a2f3-93eb9712e025 tempest-TestSnapshotPattern-1022358684 tempest-TestSnapshotPattern-1022358684-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 15:31:58.680987 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-50f37717-7406-42a3-a2f3-93eb9712e025 tempest-TestSnapshotPattern-1022358684 tempest-TestSnapshotPattern-1022358684-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 15:31:58.681504 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-50f37717-7406-42a3-a2f3-93eb9712e025 tempest-TestSnapshotPattern-1022358684 tempest-TestSnapshotPattern-1022358684-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 15:31:58.682243 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-50f37717-7406-42a3-a2f3-93eb9712e025 tempest-TestSnapshotPattern-1022358684 tempest-TestSnapshotPattern-1022358684-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 15:31:58.682639 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-50f37717-7406-42a3-a2f3-93eb9712e025 tempest-TestSnapshotPattern-1022358684 tempest-TestSnapshotPattern-1022358684-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 15:31:58.700676 n-d-791503-6 nova-conductor[98843]: DEBUG nova.quota [None req-50f37717-7406-42a3-a2f3-93eb9712e025 tempest-TestSnapshotPattern-1022358684 tempest-TestSnapshotPattern-1022358684-project] Getting quotas for project e58eab11c0904950bcba9fb794134ad2. Resources: {'cores', 'ram', 'instances'} {{(pid=98843) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 15:31:58.705170 n-d-791503-6 nova-conductor[98843]: DEBUG nova.quota [None req-50f37717-7406-42a3-a2f3-93eb9712e025 tempest-TestSnapshotPattern-1022358684 tempest-TestSnapshotPattern-1022358684-project] Getting quotas for user 08e010f44bdf44bcae9ca9e7aa8561f0 and project e58eab11c0904950bcba9fb794134ad2. Resources: {'cores', 'ram', 'instances'} {{(pid=98843) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 15:31:58.717023 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-50f37717-7406-42a3-a2f3-93eb9712e025 tempest-TestSnapshotPattern-1022358684 tempest-TestSnapshotPattern-1022358684-project] [instance: d6f0e939-9b8a-4366-ad0e-53c74a6b547e] Selected host: n-h2-791503-6; Selected node: n-h2-791503-6; Alternates: [('n-h1-791503-6', 'n-h1-791503-6')] {{(pid=98843) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 15:31:58.717888 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-50f37717-7406-42a3-a2f3-93eb9712e025 tempest-TestSnapshotPattern-1022358684 tempest-TestSnapshotPattern-1022358684-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 15:31:58.718287 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-50f37717-7406-42a3-a2f3-93eb9712e025 tempest-TestSnapshotPattern-1022358684 tempest-TestSnapshotPattern-1022358684-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 15:31:58.724482 n-d-791503-6 nova-conductor[98843]: DEBUG nova.conductor.manager [None req-50f37717-7406-42a3-a2f3-93eb9712e025 tempest-TestSnapshotPattern-1022358684 tempest-TestSnapshotPattern-1022358684-project] [instance: d6f0e939-9b8a-4366-ad0e-53c74a6b547e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='25ba6264-8204-4a67-af89-9afd3e9ec9a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98843) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 15:31:58.725695 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-50f37717-7406-42a3-a2f3-93eb9712e025 tempest-TestSnapshotPattern-1022358684 tempest-TestSnapshotPattern-1022358684-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 15:31:58.726097 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-50f37717-7406-42a3-a2f3-93eb9712e025 tempest-TestSnapshotPattern-1022358684 tempest-TestSnapshotPattern-1022358684-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 15:31:58.752784 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-50f37717-7406-42a3-a2f3-93eb9712e025 tempest-TestSnapshotPattern-1022358684 tempest-TestSnapshotPattern-1022358684-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 15:31:58.753215 n-d-791503-6 nova-conductor[98843]: DEBUG oslo_concurrency.lockutils [None req-50f37717-7406-42a3-a2f3-93eb9712e025 tempest-TestSnapshotPattern-1022358684 tempest-TestSnapshotPattern-1022358684-project] Lock "b241212c-c279-4fbb-a1e7-b87889287cbf" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 15:32:00.546188 n-d-791503-6 nova-conductor[98844]: ERROR oslo.messaging._drivers.impl_rabbit [-] [abccac45-5c00-4182-bcd1-fb6828b957ad] AMQP server on 10.222.0.68:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 28 15:32:01.565529 n-d-791503-6 nova-conductor[98844]: INFO oslo.messaging._drivers.impl_rabbit [-] [abccac45-5c00-4182-bcd1-fb6828b957ad] Reconnected to AMQP server on 10.222.0.68:5672 via [amqp] client with port 39060. May 28 15:32:25.445235 n-d-791503-6 nova-conductor[98844]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 15:32:28.052592 n-d-791503-6 nova-conductor[98844]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 15:33:36.668708 n-d-791503-6 nova-conductor[98844]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 15:33:56.042167 n-d-791503-6 nova-conductor[98843]: ERROR oslo.messaging._drivers.impl_rabbit [-] [fb67aa64-250d-4c34-b696-14a5dd0b49b6] AMQP server on 10.222.0.68:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection May 28 15:33:57.059293 n-d-791503-6 nova-conductor[98843]: INFO oslo.messaging._drivers.impl_rabbit [-] [fb67aa64-250d-4c34-b696-14a5dd0b49b6] Reconnected to AMQP server on 10.222.0.68:5672 via [amqp] client with port 39244. May 28 15:33:58.686334 n-d-791503-6 nova-conductor[98843]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4bc4adbd-2091-473e-8e44-b9a43f01ab64] AMQP server on 10.222.0.68:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 28 15:33:59.703914 n-d-791503-6 nova-conductor[98843]: INFO oslo.messaging._drivers.impl_rabbit [-] [4bc4adbd-2091-473e-8e44-b9a43f01ab64] Reconnected to AMQP server on 10.222.0.68:5672 via [amqp] client with port 39268. May 28 15:34:04.568934 n-d-791503-6 nova-conductor[98844]: ERROR oslo.messaging._drivers.impl_rabbit [-] [cbd7c90c-b59a-4f8b-992f-d04ba5ad6f9c] AMQP server on 10.222.0.68:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection May 28 15:34:05.585800 n-d-791503-6 nova-conductor[98844]: INFO oslo.messaging._drivers.impl_rabbit [-] [cbd7c90c-b59a-4f8b-992f-d04ba5ad6f9c] Reconnected to AMQP server on 10.222.0.68:5672 via [amqp] client with port 39338. May 28 15:34:36.163830 n-d-791503-6 nova-conductor[98843]: ERROR oslo.messaging._drivers.impl_rabbit [-] [eee199a3-5934-45a4-999a-298f0a81318b] AMQP server on 10.222.0.68:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 28 15:34:37.184447 n-d-791503-6 nova-conductor[98843]: INFO oslo.messaging._drivers.impl_rabbit [-] [eee199a3-5934-45a4-999a-298f0a81318b] Reconnected to AMQP server on 10.222.0.68:5672 via [amqp] client with port 39464. May 28 15:34:40.304715 n-d-791503-6 nova-conductor[98844]: ERROR oslo.messaging._drivers.impl_rabbit [-] [8840711a-c4c2-4555-9645-ce157ee9cc0d] AMQP server on 10.222.0.68:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 28 15:34:41.325742 n-d-791503-6 nova-conductor[98844]: INFO oslo.messaging._drivers.impl_rabbit [-] [8840711a-c4c2-4555-9645-ce157ee9cc0d] Reconnected to AMQP server on 10.222.0.68:5672 via [amqp] client with port 39468. May 28 15:34:46.040160 n-d-791503-6 nova-conductor[98843]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 15:35:01.565787 n-d-791503-6 nova-conductor[98844]: ERROR oslo.messaging._drivers.impl_rabbit [-] [abccac45-5c00-4182-bcd1-fb6828b957ad] AMQP server on 10.222.0.68:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 28 15:35:02.581505 n-d-791503-6 nova-conductor[98844]: INFO oslo.messaging._drivers.impl_rabbit [-] [abccac45-5c00-4182-bcd1-fb6828b957ad] Reconnected to AMQP server on 10.222.0.68:5672 via [amqp] client with port 39474. May 28 15:35:45.461485 n-d-791503-6 nova-conductor[98844]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 15:35:48.070169 n-d-791503-6 nova-conductor[98844]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 15:36:56.685883 n-d-791503-6 nova-conductor[98844]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 15:36:57.059514 n-d-791503-6 nova-conductor[98843]: ERROR oslo.messaging._drivers.impl_rabbit [-] [fb67aa64-250d-4c34-b696-14a5dd0b49b6] AMQP server on 10.222.0.68:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection May 28 15:36:58.076173 n-d-791503-6 nova-conductor[98843]: INFO oslo.messaging._drivers.impl_rabbit [-] [fb67aa64-250d-4c34-b696-14a5dd0b49b6] Reconnected to AMQP server on 10.222.0.68:5672 via [amqp] client with port 39494. May 28 15:36:59.703798 n-d-791503-6 nova-conductor[98843]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4bc4adbd-2091-473e-8e44-b9a43f01ab64] AMQP server on 10.222.0.68:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 28 15:37:00.719548 n-d-791503-6 nova-conductor[98843]: INFO oslo.messaging._drivers.impl_rabbit [-] [4bc4adbd-2091-473e-8e44-b9a43f01ab64] Reconnected to AMQP server on 10.222.0.68:5672 via [amqp] client with port 39496. May 28 15:37:05.588436 n-d-791503-6 nova-conductor[98844]: ERROR oslo.messaging._drivers.impl_rabbit [-] [cbd7c90c-b59a-4f8b-992f-d04ba5ad6f9c] AMQP server on 10.222.0.68:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection May 28 15:37:06.606932 n-d-791503-6 nova-conductor[98844]: INFO oslo.messaging._drivers.impl_rabbit [-] [cbd7c90c-b59a-4f8b-992f-d04ba5ad6f9c] Reconnected to AMQP server on 10.222.0.68:5672 via [amqp] client with port 39498. May 28 15:37:26.655581 n-d-791503-6 nova-conductor[98843]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 15:37:29.465378 n-d-791503-6 nova-conductor[98843]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 15:37:37.181807 n-d-791503-6 nova-conductor[98843]: ERROR oslo.messaging._drivers.impl_rabbit [-] [eee199a3-5934-45a4-999a-298f0a81318b] AMQP server on 10.222.0.68:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 28 15:37:38.203581 n-d-791503-6 nova-conductor[98843]: INFO oslo.messaging._drivers.impl_rabbit [-] [eee199a3-5934-45a4-999a-298f0a81318b] Reconnected to AMQP server on 10.222.0.68:5672 via [amqp] client with port 39514. May 28 15:37:41.321972 n-d-791503-6 nova-conductor[98844]: ERROR oslo.messaging._drivers.impl_rabbit [-] [8840711a-c4c2-4555-9645-ce157ee9cc0d] AMQP server on 10.222.0.68:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection May 28 15:37:42.342569 n-d-791503-6 nova-conductor[98844]: INFO oslo.messaging._drivers.impl_rabbit [-] [8840711a-c4c2-4555-9645-ce157ee9cc0d] Reconnected to AMQP server on 10.222.0.68:5672 via [amqp] client with port 39518. May 28 15:38:02.582423 n-d-791503-6 nova-conductor[98844]: ERROR oslo.messaging._drivers.impl_rabbit [-] [abccac45-5c00-4182-bcd1-fb6828b957ad] AMQP server on 10.222.0.68:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection May 28 15:38:03.599276 n-d-791503-6 nova-conductor[98844]: INFO oslo.messaging._drivers.impl_rabbit [-] [abccac45-5c00-4182-bcd1-fb6828b957ad] Reconnected to AMQP server on 10.222.0.68:5672 via [amqp] client with port 39520. May 28 15:38:06.058379 n-d-791503-6 nova-conductor[98843]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 15:39:05.479910 n-d-791503-6 nova-conductor[98844]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 15:39:08.086132 n-d-791503-6 nova-conductor[98844]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 15:39:58.077764 n-d-791503-6 nova-conductor[98843]: ERROR oslo.messaging._drivers.impl_rabbit [-] [fb67aa64-250d-4c34-b696-14a5dd0b49b6] AMQP server on 10.222.0.68:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection May 28 15:39:59.093493 n-d-791503-6 nova-conductor[98843]: INFO oslo.messaging._drivers.impl_rabbit [-] [fb67aa64-250d-4c34-b696-14a5dd0b49b6] Reconnected to AMQP server on 10.222.0.68:5672 via [amqp] client with port 39538. May 28 15:40:00.720627 n-d-791503-6 nova-conductor[98843]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4bc4adbd-2091-473e-8e44-b9a43f01ab64] AMQP server on 10.222.0.68:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 28 15:40:01.737552 n-d-791503-6 nova-conductor[98843]: INFO oslo.messaging._drivers.impl_rabbit [-] [4bc4adbd-2091-473e-8e44-b9a43f01ab64] Reconnected to AMQP server on 10.222.0.68:5672 via [amqp] client with port 39542. May 28 15:40:06.606471 n-d-791503-6 nova-conductor[98844]: ERROR oslo.messaging._drivers.impl_rabbit [-] [cbd7c90c-b59a-4f8b-992f-d04ba5ad6f9c] AMQP server on 10.222.0.68:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection May 28 15:40:07.621896 n-d-791503-6 nova-conductor[98844]: INFO oslo.messaging._drivers.impl_rabbit [-] [cbd7c90c-b59a-4f8b-992f-d04ba5ad6f9c] Reconnected to AMQP server on 10.222.0.68:5672 via [amqp] client with port 39544. May 28 15:40:16.702791 n-d-791503-6 nova-conductor[98844]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 15:40:38.199702 n-d-791503-6 nova-conductor[98843]: ERROR oslo.messaging._drivers.impl_rabbit [-] [eee199a3-5934-45a4-999a-298f0a81318b] AMQP server on 10.222.0.68:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 28 15:40:39.220782 n-d-791503-6 nova-conductor[98843]: INFO oslo.messaging._drivers.impl_rabbit [-] [eee199a3-5934-45a4-999a-298f0a81318b] Reconnected to AMQP server on 10.222.0.68:5672 via [amqp] client with port 39552. May 28 15:40:42.339008 n-d-791503-6 nova-conductor[98844]: ERROR oslo.messaging._drivers.impl_rabbit [-] [8840711a-c4c2-4555-9645-ce157ee9cc0d] AMQP server on 10.222.0.68:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 28 15:40:43.360523 n-d-791503-6 nova-conductor[98844]: INFO oslo.messaging._drivers.impl_rabbit [-] [8840711a-c4c2-4555-9645-ce157ee9cc0d] Reconnected to AMQP server on 10.222.0.68:5672 via [amqp] client with port 39556. May 28 15:40:46.674469 n-d-791503-6 nova-conductor[98843]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 15:40:49.482625 n-d-791503-6 nova-conductor[98843]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 15:41:03.599705 n-d-791503-6 nova-conductor[98844]: ERROR oslo.messaging._drivers.impl_rabbit [-] [abccac45-5c00-4182-bcd1-fb6828b957ad] AMQP server on 10.222.0.68:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 28 15:41:04.614740 n-d-791503-6 nova-conductor[98844]: INFO oslo.messaging._drivers.impl_rabbit [-] [abccac45-5c00-4182-bcd1-fb6828b957ad] Reconnected to AMQP server on 10.222.0.68:5672 via [amqp] client with port 39568. May 28 15:41:26.076807 n-d-791503-6 nova-conductor[98843]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 15:42:25.497171 n-d-791503-6 nova-conductor[98844]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 15:42:28.102141 n-d-791503-6 nova-conductor[98844]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 15:42:59.094394 n-d-791503-6 nova-conductor[98843]: ERROR oslo.messaging._drivers.impl_rabbit [-] [fb67aa64-250d-4c34-b696-14a5dd0b49b6] AMQP server on 10.222.0.68:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection May 28 15:43:00.112374 n-d-791503-6 nova-conductor[98843]: INFO oslo.messaging._drivers.impl_rabbit [-] [fb67aa64-250d-4c34-b696-14a5dd0b49b6] Reconnected to AMQP server on 10.222.0.68:5672 via [amqp] client with port 39582. May 28 15:43:01.738579 n-d-791503-6 nova-conductor[98843]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4bc4adbd-2091-473e-8e44-b9a43f01ab64] AMQP server on 10.222.0.68:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection May 28 15:43:02.755042 n-d-791503-6 nova-conductor[98843]: INFO oslo.messaging._drivers.impl_rabbit [-] [4bc4adbd-2091-473e-8e44-b9a43f01ab64] Reconnected to AMQP server on 10.222.0.68:5672 via [amqp] client with port 39584. May 28 15:43:07.623616 n-d-791503-6 nova-conductor[98844]: ERROR oslo.messaging._drivers.impl_rabbit [-] [cbd7c90c-b59a-4f8b-992f-d04ba5ad6f9c] AMQP server on 10.222.0.68:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection May 28 15:43:08.639980 n-d-791503-6 nova-conductor[98844]: INFO oslo.messaging._drivers.impl_rabbit [-] [cbd7c90c-b59a-4f8b-992f-d04ba5ad6f9c] Reconnected to AMQP server on 10.222.0.68:5672 via [amqp] client with port 39586.